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In Rauscher we seem to have another case (like Hastings) of an 
experimenter/target person/consultant/author. It is difficult to maintain 
acceptance of a "double-blind" protocol under these circumstances. 

As with the series of experiments dealing with local targets, there is 
a large number of methodological questions raised about the long-distance 


with-target-person experiments. 


Critical Evaluation: Remaining Long Distance Targets with Coordinates 

The remote-viewing experiments involving coordinates rather than a 
target person will be discussed under two categories, U.S. and foreign. 

These experiments are Limited in number and are discussed in one 
publication. (Puthoff, et al., 1977a) Two of the three experiments, those 
of the Sylvania Laser Lab, Mt. View, California, and the Lawrence Berkeley 
Laboratory Bevatron, Berkeley, California, could easily involve cueing. 
Targ, who selected the coordinates, had also worked for Sylvania. After 
five years of research effort together, it is difficult to believe that 
some sort of information did not flow between the two experimenters, and 
therefore, this target can hardly be considered "double-blind." No statement 
is made as to whether the subject, I> an experienced remote viewer and 
likely one of the six early remote-viewers, co-researcher, and experimenter 
has ever been to the target. | 

The second target, the Lawrence Beikeley Laboratory Bevatron, is also 
a opetes related to one of the experimenters, Elizabeth Rauscher, who well 
may have knowledge of this target. It is stated that the experimenter 
with subject, Hy> did have prior knowledge of the target. The experimenter 


knew the name and general function of the building and although supposedly 


- 167 
Approved For Release 2000/08/10 : CIA-RDP96-00787R000100260003-2 


Approved For Release 2000/08/10 : CIA-RDP96-00787R000100260003-2 
—SteRE 
taking precautions to prevent cueing, leading questions have been used 
before and could have been used here also. The egies of experimenters is 
obviously poor since, besides Rauscher, there are ap ede four more involved 
in the research: Hurt, Targ, Puthoff, and May. Cole may also still be 
involved. 
The description of the third target, that of the Minuteman and Poseidon 

Static Test Firings includes statements such as "'.., drawn-out muffled roars’ 


which ! 


raised dust clouds' and involved 'glowing melted materials’ ...." (p. 75) 
could also apply to what could be observed from a distant viewing. With as 
many people involved in the project and with knowledge of the coordinates, 
it would not be difficult to have an observer near the spot to report the 
actual time of the firings. Two subjects ous aansed in this experiment, 
I, in Menlo Park who participated in all five experiments and Hy in L.A. who 
participated in two. Why did Hy only participate in two? 

Previously, more than one reading has been allowed in both the local 
and long-distance experiments and the same questions apply to these experiments, 
such as: Was there any form of feedback given to phe subject at any time 
during the experiment? What time period elapsed pecaeen first ane second 
readings? 

The foreign targets are an R&D test facility and some Russian sites. 
Of the poratga targets, thie R&D test facility also appears to have had 
many readings. This target, however, is identified to the experimenters not 
only by coordinates but also as being an R&D test facility. Two clues are 


already available to the experimenters. It is difficult to estimate how 


much could be guessed (or cued to the subject) knowing the sponsor. 


; 168 
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Price is the sepieed for this bis saeaet "Pigure 1 shows the Level 
of detail for a sample early effort at drawing a gantry crane he observed .... 
(SRI paeeeee Report, August 1974, p. 3) Price Seeus to have been a fairly 
decent artist if his sketch of the swimming pool complex is any indication 
of his ability. (Mind-Reach, p. 54) Why then the need, in an early drawing, 
for such a precise rule-drawn sketch? Was the drawing really his first? 

The remaining experiments are Rusgian-based talpete and appear to be 
grouped around Moscow. This in itself ia an advantage since only this area 
would need to be covered with finely detailed maps. Two subjects participate: 
oT aad Ey: anew pubject apparently since this letter designation has not 
been used earlier. | 

The experimenters passed the coordinates to I; which are of a population 
center. The subject, however, described eden and an airfield. When these 
descriptions do not match the actual coordinates, 1, requests an overvtew of . 
the area. which now does include the airfield, thus making his description 
appear correct. In effect, attention is drawn away from the non-corresponding 
elements and drawn to those that do correspond much as a magician does in 
his routine. The use of pictures, although for the reader's sake, and the 
use of standing at specific spots for judging, quoting only certain elements 
of a transcript, are also ways in which this same diversion-of-attention 
procedure seems to be used. That this type of behavior is used is not 


unremarkable considering that Targ was an accomplished amateur magician. 


"Magic tricks fall into two general categories which I will call 'sleights'. 


and ‘illusions.’ Sleight-of-hand tricks are simply misdirections of the 
observer's attention by the performer. In magic, as in psychic research, 


attention is everything .... However, attention will not help you keep 
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track of the other form of trick, an iiaueton -».» An illusion, ..., is 

any trick in which the observer is invited to greatly underestimate the 
amount of preparation necessary to create the 'effect.' .., This preparation 
may have begun the moment iectew nel ak learned that on a particular day in 
the next month he will have a meeting with a given person who just might ask 
to be shown some magic. And with a month to ree for a meeting, a 
magician can do anything. A magician will spend. that kind of time to prepare 
a single trick, because that's what he does for a living." (Mind-Reach, 

pp. 139-140) 


In the same experiment, E, is told to search the general coordinate area, 


1 


specifically for an airfield. If these instructions were given, they must 


18 request for an overview of the area or both 


have been given following I 
were cued to look for such. 
The second site was one of no special interest containing a town within 

Speen area. Reference to an Atlas iaaieates this quite easily. Puthoff, 
Targ, and May (1977) conclude that this experiment "... provided an opportunity. 
to verify that (1) the subject's output is not simply geared to match the 
expectations of the experimenters ...."" [Do they really mean the "expectation 
of the experimenters" or should they say, what is expected from those 
designating the target?] 


".., (2) the subject does not simply conjure up what may reasonably be 


W 


expected to be correct .... {[Here, again why should the subject "expect" 
anything?] "... and in fact describes the area appropriate to the coordinates 
even. though it may run counter even to the subject's own expectations." 


As has been stated previously, any knowledge of this area would provide 


the information that the subject describes. However, the subject may have 
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| been very surprised at this set of coordinates. 

The remaining experiment is a ten-site scan about ten the above comments 
can also apply. The one site mentioned is also centered around Moscow and a 
general description of the site could be obtained from a map. Since the more 
specific elements have not been verified to us, it is difficult to discuss 
this series further. 

Puthoff,: Tare, and May use four other studies as verification of their 
remote-viewing studies. In Mind-Reach , they state: "In the fall of 1974, 
we had already concluded most of the experiments described thus far. Our 
work was going well. ence laboratories were beginning to replicate our 
remote viewing experiments." (p. 90) The first study using their protocol 
is that of Rauscher, et al., reported in August 1975. As has been stated 
earlier, this author econde & consultant and experimenter for the SRI team. 
This study, however, did not show significant renuless 

In March 1976, IEEE issused a formal call for papers: "We would 
encourage others to repeat their experiments and to report their results, 
whether they be positive or negative." (p. 291) 

As has been sea earlier, Hastings, also involved in the SRI studies, 
and Hurt, also involved, run Piate euperinane in early March (See Table 1.), 
although these results are not published until October 1976. Whitson, Bogart, 
Palmer, aua Tart's paper is also received in late March. Tart has also 
been involved in the remote viewing studies: "... the authors have benefited 
greatly from their many discussions with ... Dr. Charles Tart ...."  (Mind- 
Reach, p. viit) Vallee, Hastings, and Askevold's paper is received in early 
May. jee tdiven ta ares involved in this study in addition to being a co— 


researcher with Tart in another study. (Tart, 1977, p. 165) O£ these, 
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three are used to "verify" their data. The remaining study is that of Bisaha 
and Dunne, and is not reported until August 1976. Their first study actually 
deals with precognition. Their second weidy te an. ecveusion of the precognition 
work and was reported in September 1977. These experiments are discussed in 
the following section so will not be dealt with here. One should note, however, 
that they conducted a series of five precognition experiments between the U. 5. 
and Czechoslovakia and the U.S.S.R. while one of the experimenters was in 
Eastern Europe in August 1976, although their other experiments are confined 
to the Chicago area. | 

In conclusion, the comments made in reference to the judging of transcripts 
for the local remote viewing series seem applicable here. "Since the judge 
did not know a prior? which elements of the descriptions were correct or . 
incorrect, the task was complicated, and transcripts often seemed plausibly 
to match more’ than one target. A confounding factor in these studies is 
that some target locations have similarities that seem alike at some level of 
perception ... a radio telescope at the top of a hill, the observation deck 
of a tower, and a jetty on the edge of a bay all match a transcript description 
of ‘looking out over a long distance.’ ... According to the judge, the most 
successful procedure was a careful element~by-element comparison that tested 


each transcript against every target ....' (Puthoff and Targ, 1976b, p- 346) 


D. Alphabet Letter Experiments 

As a result of previous research, Puthoff and Targ (1977) concluded that 
"The problem in the forced-choice matching experiments, as opposed to the 
free-response task, is that the subject's stored mental images are available 


to him from his memory, and constitute an important source of ‘noise’ in the 
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remote viewing channel." This ig supported by the following experiments. 
Subjects Hy and I Bueetcipated in twenty letter-guessing trials, H, 

in her Los Angeles home and I, in his New York City home. One letter target 

was peated each day in the SRI laboratory. Subjects were to attempt to 

identify the letter. The results are not given in the 1977 technical report, 

although the authors state that the results were "not found to depart from 

chance expectation." Since > 2 correct would be required (of 20 trials) 

to obtain p < .05, and > 3 at p < .01, we must assume that neither subject 

hit on more than one target, assuming further that the 20 targets were 

sampled with replacement from a full Aueher 26. Very incomplete 

vanevelae of this experiment makes an analysis of the results quite tenuous. 
In a second alphabet remote viewing experiment, subjects 8, and Hy 

were asked to draw what they saw posted a few laboratories away. Puthoff 

then blindly estimated the lettera based on these drawings. S, was correct 


1 


on 2 of 2 trials, while H, was correct on 1 of 3 trials. 


The probability of S, being correct, by chance, on both trials is 


1 


p = .0015; the probability of H, being correct on 1 of 3 trials is p = .0043; 


1 
the combined results of 3 or more correct out of 5 trials is significant at 
p= 5.36 x 107" by the binomial theorem, as reported by the authors. Thus, 
the obtained results clearly exceed chance expectations for each subject, 
and for the combined nee 
The authors conclude that "This suggests that the way to iaapidee the 

analytical Sapa ey to include written material is to arrange to separate 
the perception from the analysis, _ encourage the subject to describe only 


his or her perception, and to follow up by having a different person do the 


final analysis on a blind basis." It seems that improvement .can be made on 
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this protocol by having the judging done on a veal blind (or double-blind) 
basis, that is, by having the judge otherwise naive about the experiment. 


Puthoff did the judging in this experiment. 


E. Random Stimulus Generator Experiments 
A four-state random generator was designed to evaluate how well subjects 
could learn to guess which of four letters would next appear on a display. 
This experiment. is discussed in Puthoff and Pave (1977) and in Targ and 
Puthoff (1977). 
- The data for four experiments with subject 2 are shown in Table 10. 


The authors state that the "probability of > k successes inn trials is 


obtained by table lookup of the probability of a normal distribution value 


b> k-F- 47 (3n/16)"/?. ; (2) 


It is perhaps worth noting that. the t deeeeinderes is not a normal (2) 
distribution, and that experiments 3 and 4 had results which did not exceed 
chance. While the overall results are clearly significant, the subject's 
ability deteriorated over the four experiments. In fact, the high hit rate 
on experiments 1 and 2. Prat = 0.36) was high enough to sustain a significant 
result for the total data set even if the subject ran another 700 trials 
at exactly chance (P = 0.25) performance. Thus, the decision to stop after 
eieelene’ seems to be one of nota strategy. 

While the conversion from the obtained number of hits to a t value is 


unreferenced, one can also verify the results by either a critical ratio 
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e 
TABLE 10. RESULTS OF SUBJECT L, ON RANDOM STIMULUS 
GENERATOR EXPERIMENT 
= TARGET NUMBER OF ‘NUMBER - 
EXPERIMENT LETTERS TRIALS, n OF HITS, H P 
a 1 ARTO. 200 64 2.20 0.014 
9 Rane 100 44 4.27 1.07 x 107 
= 3 _EHLT 100. 31 1.27 0.102 
4 KWYZ 100 28 0.58 0.28 
wa 
500 167 4.29 L4G 
nena ne ns ene 
- o 
be es - - 4 n/ie)"”?, for p = 1/4 
z 
and k is number of hits on 7 trials. 
- 
= 
= 
a 
vex 
=z 
C 
E | 
; . 
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and 2800 trials, respectively, with mean percent hits of .305 (p = 2x 10°~) 
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equivalent (Siegel, 1956) or by the exact binomial. Recalculation of the 


p-values by the binomial for the four experiments yields 0.010, 1.09 x ig. 


0.069, and 0.930, respectively. Thus, experiments 1 and 2 remain statistically 


significant, while experiments 3 and 4 remain nonsignificant. By the exact 


binomial, the total of 167 hits of 500 trials is also significant, p = 0.00001. 


The authors conclude (Puthoff and Targ, 1977, p: 33) that "... the 
results obtained in the sepbeasvaswane and machine approaches to reading 
remote diptabeehecastens do indicate a potential for developing acceptable 
levels of reliability in reading text for operational purposes. Further 
study is required to determine whether this reliability can be achieved with 
a reasonable effort." 

In a previous experiment with the random stimulus generator, the six 
remote viewing subjects (S) through Se. presumably) were tested. Only Elgin 
(S.) showed performance greater than chance (Targ and Puthoff, 1977, p. 129). 

In another, NASA-funded, study, 145 volunteer subjects were tested, 79 
adults and 66 children. Of these, six subjects had a significantly positive 
slope (p < .01) over an undisclosed set of trials. (Targ and Cole, 1975, 

p- 28) 
Two other subjects had significantly beyond chance scores over 1400 


6 


and .2957 (p < 107°), "These results indicated that the ESP machine can 


gerve as a suitable screening device for those with ESP ability." 


(Targ and 
Cole, 1975, p. 29) Unfortunately, the above results are predicated upon a 


true a prtort probability of 0.25; i.e., the generator is indeed random. 


As will be discussed later, this assumption is questionable. 
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Critical Evaluation 

The authors conducted a reasonable evaluation of the statistical random- 
ness of the four-state generator, Without question, the zero and first-order 
probabilities of occurrence are within random chance fluctuation. 

A separate analysis was apuauecea by the sponsor, and reported in an 
internal memorandum. The results of this analysis are quite interesting. 
Table 11 gives the numbers of nonidentical transition frequencies, i.e., 
the next-to-be-generated color, following the present color. These sequences 
of pairs of nonidentical colors, both forward and backward, are shown in 
the lower half of Table 11. 

The forward and backward pair frequencies are all within random bound 
expectations. However, one would also expect no correlation between the 
forward and backward pair frequencies. That is, the likelihood of a given 
color following any other color should be unrelated é the reverse order of 
occurrences of those pairs. Such is not the case, for the correlation between 
the two columns of pairwise frequencies in this table is r = 0.93, p < .O1. 
The mean forward frequency (788) across all pairs does not differ significantly 
from the mean backward frequency (798). 

Combining the forward and backward frequencies, the differences among 
the six transition frequencies are statistically significant Gr = 13.34, 
af = 5, p = 0.02). Thus, a successful strategy that could be adopted to 
exceed chance is: "When green press red, when red press green, and otherwise 
use 'pags' ee as much as possible." This strategy will increase the 
hit score and, given enough trials, yield a significant result. 

There is no evidence that Elgin, or ary other successful subject 


followed this strategy. Neither is there any evidence they did not. A 
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TABLE 11. NONIDENTICAL TRANSITION FREQUENCIES IN FOUR-STATE GENERATOR 


NEXT STATE 
CURRENT STATE YELLOW GREEN BLUE RED 
Yellow (Y¥) ~ 764 765 790 
Green (G) . 777 - 773 863 
Blue (B) ‘ : 776 796 2 773 
Red (R) _ 787 852 803 z 
TRANSITION PAIR FREQUENCIES FORWARD BACKWARD 
| Y/G 764 TTT 
Y/B 765 776 
¥/R 790 787 
G/B | 773 796 
G/R 863 852 
B/R 773 803 


ion | age 
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careful analysis on successful subject's sequences would be interesting. In 
any event, the lack of accessibility (and time to analyze) the actual data, 
coupled with the above critical analysis, appears to be ample justification 


to question the validity of the reported positive results. 


F. EEG Experiments 

Targ and Puthoff (1974) described an experiment "undertaken to determine 
whether a physiological measure such as EEG activity could be used as an 
indicator of information transmission between an isolated subject and a 
remote stimulus." (p. 606) | 

Sender and receiver pairs were used, with visual and Hischpondenenie 
shielding between them. A photostimulator was activated for 10 s duration 
in front of the sender; the receiver's EEG was recorded at occipital location 
o with a bandpass of 1 to 120 Hz. The photostimulator operated at three 
ereadeaeides QO (mo flashes), 6 flashes per second, and 16 flashes per second, 
randomly intermixed. 

No EEG driving was noted in any of the six volunteer subjects; however, 
one subject (Hammid) showed a consistent alpha frequency Rivers effect. 
Data from seven sets of 36 trials each were then collected from this subject 
on three separate days. 

Fourier analysis of the spectra showed reduced power at 16 flashes/s 
in the 9-11 Hz region, as compared to the 0 flash/s (control) condition. 

The 6 flashés/s power was between the 0 and 16 flashes/s levels. The 
average power and peak power were both significantly less at 16 flashes/s 
than at 0 flash/s (p < 0.04 and p < 0.03, respectively). The 6 flashes/s 


power values, while in the "right" direction, did not differ significantly 
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3. The demonstrated remote viewing ability appears to be insensitive 
to time and distance. 

4. Real-time, movement-containing activities can apparently be seen 
through this ability. 

5. Untrained subjects Hen demonstrate this ability and improve with 
practice, often sedans information as valid as that of known "sensitives." 

6. The remote viewing channel is quite noisy. Concepts of information 


theory pertinent to S/N improvement appear to apply to this channel as well. 


Negative Characteristics 
1. Research reports are of behavioral data, yet are not presented with 
sufficient, rigorous experimental detail appropriate to behavioral science 
publications and acceptable to sehaGioxal scientists. 
'2. Conflicting, inaccurate reporting of experimental "facts" detracts 
from the acceptability of the results. 


3. Methodological weaknesses in the local target and long-distance U.S. 


target procedures provide alternate (i.e., nonparanormal) possibilities of 


explanation. 


Approved For Release 2000/08/10 1%1A-RDP96-00787R000100260003-2 


Approved For Release maine = “Sa lial alae a 


TII. DESCRIPTION AND CRITICAL EVALUATION OF NON-SRI REMOTE-VIEWING 
EXPERIMENTS 

In this section of the report we describe the non-SRI published (and in 
one case unpublished) remote-viewing experiments. Although the reporting 
format differs greatly among these experiments, an effort is made to present 
‘each experiment in the same format to permit direct comparison of experimental 
methods and results. 

Following. the description of each experiment, a critical evaluation of 
the methodology is presented. Features of the experiment which are considered 
to be of good scientific technique are pointed out. Similarly, weaknesses 
of the methodology are also indicated. Following the philosophy that such 
research, to be universally accepted, must be totally free of critical 
methodological flaws (or possibilities thereof), emphasis is deliberately 


placed upon known or potential "soft" spots in the methodologies. 


A. Allen, S., Green, P., Rucker, K., Cohen, R., Goolsby, C., and 
Morris, R. L. A remote viewing study using a modified version © 
of the SRI procedure. In J. D. SETS), W. G. Roll, and R. L. 
Morris (Ed.), Researeh in Parapsychology » 1978. etude, N.J.: 


The Scarecrow Press, 1976, 46-48. 


Purpose. The purpose of this experiment is to repeat the general SRI 
procedure, with modifications considered appropriate by the authors. 

iouinontal Destgn. Twelve remote-viewing sessions were run by a 
three-person group. Each member of the group was subject (receiver) for 
four eeinees target person for four sessions, and experimenter for four 


sessions. Twelve targets were used, without sampling replacement. 
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. Subjects. All three subjects gereeneulente in a research methods 
class. The subjects had been conducting critical assessments of a vartety 
of (presumably related) experimental procedures. 

Expertmenters. Same as subjects, see experimental design. 

farget Persons. Same as subjects, see experimental design. 

Suge Indicated to be "blind"; no additional information given. 

Equipment. Subject performed in a University of California, Santa 
Barbara experimental room and’ recorded all verbal responses on a tape 
recorder. No additional information is given on the room or the tape recorder. 

Targets. Twelve targets "were drawn from a population of 30 varied 
locations (indoors and outdoors) within a half-hour drive of the UCSB campus. 
No location was used twice." No additional information is given on any of 
the targets, such as what they were, how similar or different to one another, 
who chose the population, etc. 

Procedure. At the beginning of each session, the three-person group 
met in - UCSB experimental room. Roles were assigned to each person and 
watches were synchronized. The target person then left the others and 
obtained from R. L. Morris a "randomly selected target location concealed 
inside an envelope." 

The target person then went to the assigned location, timing his arrival 
eo be half an hour after ieee the subject and experimenter. He remained 
gee for 15 minutes, observing the physical surroundings and taking notes. 
He ies left the target to return to the experimental room. 

Experimenter and subject relaxed in experimental room until target 
person was to arrive at target. Then, experimenter turned on tape recorder 


and recorded verbal, viewing responses of subject. Experimenter "occasionally" 
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sought clarification of a subject's statement or asked for. more detail. 
Tape recording ended after 15 minutes, or when target person left target. 


Target person gave subject verbal feedback upon his return. 


Data Analysts. The 12 tapes were transcribed and given to 3 judges 
along with target locations. One judge "chose to use a matching method 
in which he visited each location and matched it with a transcript which 
most resembled it. The same transcript could be chosen for more than one 
location." 

The other two judges "used a rating method which permitted quantification.” 
Each of the 12 transcripts was rated in terms of its similarity to each of 
the 12 locations as the judges visited each location. A six-inch line was 
marked to indicate between "no correspondence" and "complete correspondence." 
Confidence ratings were also obtained but not analyzed at time of reporting. 

Means ‘and standard deviations of ratings, across the 12 transcripts, 
were calculated for each target for each of the latter two judges. Rating 
for correct transcript was determined, in Z-score, for each target. 

Results. Judge who used matching method got one hit out of twelve, 
which is chance performance. 

Of the other two judges, one rated the correct transcript above the 
mean on 4 of 12 targets; the other judge rated the correct transcript above 
the mean on 3 of the 12. Six would be chance performance.  Interjudge 
agreement of sign (above or below mean) was very good, with such agreement 
on 11 of 12 targets. 

"There was an insignificant but suggestive decline in results from the 
first six sessions to the last six." 

Thus, peciiee were decidedly negative. No evidence for remote viewing 


was obtained. 
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Conelustons. Although results were negative, authors note three 


differences from SRI procedures. (1) Subjects were students critically 
evaluating research methods, and "may thus have found it hard to maintain 
the mind-set of complete confidence that appears to be a vital part of the 
SRI procedure." (2) Data were gathered in.a preset finite time period, 
and “later sessions had a more hurried aspect to them.” (3) Feedback was 
limited to verbal feedback by pap coe newson: subjects did not visit target 
locations. 

Critical Evaluation. Several procedural weaknesses, or loci of criticism, 
can be noted in this research. | 

(lL) No rationale is given for departure from the SRI peeidynean,. ohehbiah 
these departures are used to "explain" the negative results. Thus, the 
experiment should not be considered a critical test of the SRI procedure. 

(2) Subjects (and therefore target persons and experimenters) could 
clearly be negatively biased toward existence of RV capability. 

(3) No indication is given of order of each subject serving as subject, 
experimenter, target person. This could be critical. For beatgaies if target 
person or experimenter concluded that previous sessions led to negative 
results, then their performance as subject could be adversely affected 
through nonbelief or low motivation. 

(4) No information given as eo: 4waeruarions to judges, why they were 
permitted to use different judging procedures, who they were, etc. 

(5) Targets were undefined, no indication of target similarity was 
given, and nature of target population was unspecified. Further, it is 
not known who selected (and therefore knew) target population. Finally, 


it is not known if any subject had previously seen any target location. 
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(6) Did target person visit ecpuek atonet How was this verified? 

Did target person concentrate on "transmitting" to subject? Because target 
person can reasonably be considered a skeptic, these essekns ea be highly 
pertinent to the obtained negative results. | 

(7) Nature of feedback to the subjects is not described. Tf inadequate, 
it could lead to deterioration in performance over trials. While this 
deterioration is suggested by authors, the nature of the statistical test 
is not given. 

(8) -No quantitative data (Z-scores, signs, rating scores, rankings) 
are given. While results are considered aegaeive; data could be of interest 
to other, researchers. 

Summary. In anmae this experiment produced negative Beaed, However, 
it has sufficient methodological suaiteievanetes to question the completeness 
of the procedure. Were the results positive, numerous methodological problems 
would cause us to question the validity of the results. The same questions 


should apply to acceptance of the negative results. 


B. Bisaha, J. P. and Dunne, B. J. Multiple subject and long distance 
remote viewing of geographical locations. In Proceedings of the 
Internattonal Conference on Cybernetics and Society, IEEE, 19-21 


September 1977, Washington, D.C., 512-516. 


Purpose. The first experiment tested the abilities of pairs of subjects 
simultaneously to predict where the experimenter would be in the future. 
The second experiment required the subject to predict, 23 to 24 hours in 
advance, where the experimenter would be over 5,000 miles away. These two 


experiments are described separately below. 
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Experiment One 

Bepertmental Design. Seven subjects were tested (in four different 
subject pairs) on seven targets in the Chicago area, for a total of 14 
subject transcripts. No effort appears to have been made to randomly or 
logically pair the subjects. For the seven target encounters, the indicated 
subject pairs, by subject number, were: (4,5), (10,9), (4,5), (6,7), (5,4), 


(6,8), and (7,6). 


The transcripts were randomly divided into two sets (A and B) for 
scoring. The first member of each pair.of subjects had his/her transcript 
assigned to Set A, the second to Sect B. 

Subjects. Subjects were volunteers, two males and seven females, 
ranging in age from 24 to 37. Sunancts knew each other, but were unrelated 
by blood or marriage. 

Expertmenter(s): No mention is made of the identity of the experimenters; 
they are probably the authors. 

Target Person. This is one of the experimenters (female), identity 
not piven otherwise. | 

Judges. These were "six persons, not otherwise affiliated with the 
experiment." No further information is given. 

Equipment. subjects? responses were tape regeeaaieaio other equipment 
is seantened Target locations were photographed by the target person. 

Targets. “The seven targets were randomly selected from the "target 
pool of over one hundred locations in the city and suburbs of Chicago, 
seevaneiy compiled and sealed [in envelopes] by an individual who had no 
other association with the experiment." The contents of the envelopes 


(target pool) were unknown to either experimenter or subjects. 
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pe Procedure. Experimenter explained nature of the experiment to subjects 
before the trials began, and ‘iy were told they would have sufficient time 
= to relax, become comfortable, and allow their minds to become as blank as 
possible. ‘They were then instructed to visualize where the experimenter 
- _would be between 35 and 50 minutes after the trial began. They were asked 
= to describe whatever images or thoughts they had, during that 15-minute 
period, into a tape recorder, and to make any sketches if they wished. They 
= were asked not. to try to define specifically or identify their impressions, 
but to describe them generally with as much detail as possible, "even if 
+ the images appeared to make no sense or have no continuity." Subjects 
as within pairs were to have no communication with each other during the trial. 
In four trials (undefined), subjects were in separate rooms on different 
= Floors of the same building. In the other three trials, they were approximately 
10 fies apart. 
~ 
“When subjects began generating their descriptions, an experimenter left 
- the area with ten envelopes which had -been randomly selected from the vee 
‘pool of over one hundred locations .... Driving continuously for 20 minutes 
~ with no particular direction, or until five minutes after the subjects had 
completed their descriptions, the experimenter then blindly selected a 
> number from one to ten from an enclosed container holding ten numbered and 
ws folded sheets of paper; counted down to the chosen number of envelopes, 
opened the envelope and proceeded to the location indicated on the enclosed 
- card, arriving at the target 15 minutes later, or 35 minutes after the 
subjects oupiad recording their descriptions. The experimenter remained 
mm at the target for 15 minutes, photographed the location and made notes as 
a to her impressions of the site, then returned to the point of origin .... 
a) 
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Typed unedited transcripts were made of the subjects’ recorded responses 
and attached to any associated drawings which a subject may have made." 


No mention is made of feedback to the subjects. 


Data Analyate. The 14 transcripts were divided into iwe sets, A and 
B. Set A consisted of the subjects 4, 10, 4, 6, 5, 6, and 7, while Set B 
consisted of 5, 9, 5, 7, 4, 8, and 6. Two judges blind ranked Set A 
transcripts against the target photographs and notes; two other judges 
blind ranked Set B transcripts against the same photographs and notes; and 
two final judges blind ranked Set A transcripts against Set B transcripts. 
Each set of rankings was on a 1 £6 7 Bais. with all transcripts force 
ranked against each target. 

Morris' (1972) method of evaluation of preferentially matched free- 
response material was used. (This method is described and evaluated in 
Appendix A of this report.) Results are given in Table 12 As seen there, 
all four judges successfully match eis transcripts to the targets (p < .01). 
Further, the two judges comparing Set A with Set B transcripts had sums of 
ranks of 12 and 14, respectively, siden are also statistically significant 
(p < .005), as indicated in Table 13, 

Of the ‘oian of 42 rankings made, 17 were direct hits. (Chance level 
is 1/7 x 42 = 6.) "The degree of accuracy varied among subjects, as did 
the specific details of the target." Transcript excerpts are given for 
Plaza del Lago and the NWRR Station. 

Conelustons. Results from Experiment One are clearly positive. A1l 
judges were able. to compare transcripts to the seven targets well beyond 


chance probabilities. 
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TABLE 12. RESULTS OF EXPERIMENT ONE OF BISAHA AND DUNNE (1977) 


RANKS ASSIGNED 
SUBJECTS SET A SET B 


TARGET A -B JUDGE 1 JUDGE 2 JUDGE 3 JUDGE 4 
Plaza del Lago a) an 1 5 4 2 
Wrigley Field . 10 9 i 1 3 2 
Techny Mission 4 5 3 i 1 , 3 
Tandheiner Obs. 6 on 2 3 a 3 
Madonna del Strada 5 4A 3 1 2 2 
NWRR Station 6 8 2. 1 3 1 
Grant Park Bandshell 7 6 | 3 1 1 <2 
Sum of Ranks , 15 13 15 15 
Associated p-value < .01 < .005 < .01 < 01 


ee Hl A I A, 
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TABLE 13. SET A VS. SET B RANKINGS FROM BISAHA AND DUNNE (1977) 


Ly 


RANKS ASSIGNED 


TRANSCRIPT OF JUDGE 5 JUDGE 6 
Plaza del Lago 1 1 
Wrigley Field 2 | 2 
Tethny Mission , ; 2 2 
Lindheimer Obs. 1 1 

- Madonna del Strada 2 3 
NWRR Station . 3 4 
Grant Park Bandshell _ 1 1 
Sum of Ranks 12 14 
Associated p-value < .001 < 005 
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Kxpertment Two 

Experimental Design. Five trials were conducted, over a five-day 
consecutive period, with the subject in the midwestern U.S. and the target 
person in Eastern Europe. Subject Sesponded petweea 8:30 and 8:45 AM (CDT), 
while target person was at target location between 3:00 and 3:15 PM (local 
time) 23-1/2 to 24-1/2 hours ieee. Distances wane 5087 to 5284 miles. 

Subject. No description or mention is made of subject, selection 
procedure, or his/her experience, 


Lepertmenter. No mention is made of any experimenter located with the 


‘subject. Presumably the timing and protocol were previously established, 


requiring no experimenter to be present during the trials. 

Target Person. Probably this-is the senior author, although such was 
not stated explicitly. 

Judges. The subject, the target person, and a third person, who had 
no connection with the experiment, served as judges. | 


Equipment. A tape recorder was used to record subject's target 


_ descriptions. No other equipment or subject location is mentioned. 


Targets. Five locations where the target person happened to be at 
the predetermined times served as targets. No mention is made of how such 


locations were chosen. 


Procedure. At the preset times the subject described the target. person's 


location, 23-1/2 to 24-1/2 hours in advance, Descriptions were tape recorded 
and subsequently transcribed. 
The target person concentrated on his surroundings, took a photograph, 


and wrote brief target descriptions during the preset time periods. Upon 


his return, target person presented the five photographs and brief descriptions 
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in random order to the subject for matching. Subject gave the target person 
copies of the transcribed descriptions, also in random order, for bance 
parece to blind match against the targets. Also, a (third) judge blind 
eanked the photographs against the subjects' descriptions. 

Results. Following Morris' (1972) procedure (Appendix A), the results 
are shown in Table 14. All three sets of ranks produced a result beyond 
chance significance. Transcript excerpts from the Danube River and Exhibition 
of Economic Achievement targets show meaningful’ commonality between descriptions 
and targets. 

| Conelustons. Distance and time appear to pose no barrier to the ef fective- 
ness of the RV channel. 

Critteal Evaluation. The methodology can be easily criticized on several 
mechanical issues. First, the pairings of subjects were odd in Experiment 
One: S,, and S. served three times each, always paired together; Se served 
three times, paired twice with S53 8, served twice; and Sg» Sqs and S40 
served once each. This does not appear logical by any system of a prtort 
planning. If experience in this type of task is pertinent to PEEL OFUANOE, 
then confounding surely has beeuread: 

Secondly, some subjects were watched during the trials, while others 
were not. eee is made of how, by whom, why not all, etc. This 
inconsistency also contaminates the results. 

Third, judges were avasunubiy naive. Instructions to judges are not 
given. 

Fourth, inconsistent locations of the subjects further confound the 
results. Are some locations better than others? Did subjects communicate 


telepathically between themselves? Did they do so only at given distances? 
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In certain locations? The fact that elieweaes are significant statistically 
and the assertion by the athe Chae "the reports of the subjects in each 
pair differed enough to make it obvious diet ».. the perceptions reflected 
individual differences" do not rule out such intersubject communication. If 
such communication existed, it was possibly inconsistent across Sap ieee 


pairs due to the various circumstances of the trials. 


Fifth, were the targets really hiseaved nandonty in the Chicago area? 

If the target ‘person drove éeacinionaly for 20 minutes with no particular 
direction, opened the envelope, and then had only 15 minutes to get to the 
target, tie “tadial distance from the Svante point had to be somewhat 
constrained due to Chicago size and traffic density. These Seaaceaies are 
not. mentioned. 

While the Experiment One excerpts appear very accurate, the judges' 
responses are not that impressive for the targets for which excerpts are 
printed (means of 3 and 1.75, respectively), not as good, on the average, 
as that for all targets combined (mean ante = 2.07). Thus, one must conclude 
that (1) all transcripts had elements pertinent to these targets, or (2) 
the judges were not particularly accurate in the use of specific transcript 
information. Since the judges behaved well above chance, (2) is illogical 
and one must admit that transcript element commonality (1) is a distinct 
erent (This will be discussed in Section III as part of the response 
criterion problem.) 

An ipenestine question is whether the mean rankings, by target, for 
Sets A and B are correlated with the mean agreement rankings, by target, 
as given in Table 12. If a positive correlation exists, one might logically 
conclude me! targets which lead 66 better remote viewing (Table 12) can 


also be judged more reliably (Table 13. A product-moment correlation 
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between the mean ranks, by target, in Tables 12 and 13 was calculated; its 
value is - .51 (p > .05). While not statistically significant, the negative 


correlation casts some doubt as to the logical and consistent intertarget 


differences. 


The methodology in Experiment Two is very poorly described or controlled. 
No mention is made of the following: 

(1) Who was the subject, his/her experience, how chosen, etc.? 

(2) Where was the subject during each trial, with whom, etc.? 

Why was only one subject used? 

(3) Who was the target person? Did the subject or anyone else 
know anything of his itinerary? Did the subject know anything about his 
particular tourism interests? 

(4) Use of target person and subject as judges is unusual. Why 
not employ more than one "naive" judge? 

This second experiment is niet too loosely reported. 

Summary. While the results of both these experiments are impressive 
and statistically significant, the methodology has several shortcomings, at 
least as reported. More detailed reporting of procedural steps, subject 
assignments and selections, and the like would produce greater confidence 
on oe part of the reader. 

In their introduction, the authors state that "over twenty laboratory — 
experiments have been conducted in our lab with more tise ten subjects 
involving the precognitive protocol" and that positive results have been 
obtained for each subject. This paper describes 12 trials, using eight 
subjects. The next reported experiment (Bisaha and pune. 1977b) used 
eight trials and two subjects. These sum to exactly twenty trials and ten 


subjects, assuming the subjects are all different, which cannot be determined 
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from the reports. If the authors have performed "over twenty experiments" 
using "more than ten subjects" the remaining data are unknown to us. It 
should be noted that subjects in Experiment One are numbered Sy, through Sig? 
and the subject in Experiment Two is not numbered. The two subjects in 


Bisaha and Dunne (1977b) are similarly not numbered. 


C. Bisaha, J. P. and Dunne, B. J. Precognitive remote viewing in 
the Chicago area: A replication of the Stanford experiment, 
In J. D. Morris, W. G. Roll, and R. L. Morris (Ed.), Research in 
Parapsychology, 1976. Metuchen, Nodes The Scarecrow Press, 1977, 


84-86, 


Purpose. The purposes of this research were (1) to investigate the 
ability of untrained persons to perceive and describe remote sites before 
the target locations have been determined, thus replicating the SRI 
experiments, and (2) to explore conditions of spatial and temporal 
separation between subjects and target persons. 

Experimental Design. Two. subjects received a total of eight trials, 
six for one subject and two for the other. Subjects were to describe the 
target prior to target visit by target Sarda: 

Subjects. Two volunteer female college students served as subjects. 
No other information is given. 

xperimenter. Experimenter was not specifically identified, but text 
suggests it was J. P. Bisaha. 

Target Person. One of the "experimenters," apparently B. J. Dunne. 

Judges. The three judges _— persons "not otherwise connected with 


the experiment." No additional information is piven. 
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Equtpment. The only apparent equipments are a tape recorder and 
camera. Sketches. were made by subjects on paper. 

Targets. The target pool contained over 100 sites in the Chicago area 
or suburban area lying within a radius of a 30-minute drive from Mundelein 
College. Specific targets (eight) used in this experiment are not defined. 

Procedure. The subject was told about the nature of the experiment, 
the procedure to be followed, and asked to relax, become comfortable, and 
"let her mind -become blank." At that point she was to try to visualize 
the location where the experimenter would be 35 minutes later. She had 15 
minutes to describe the location aloud into the tape recorder and to make 
sketches of her image of ais Rateer location. She-was advised not to 
attempt to define or identify specifically what she saw, but to SEtee ae 
general descriptions and impressions. She remained in a closed room with 
an observer who had no knowledge of the target location. 

The target person left the college at the same time the subject began 
her description. The target person carried 10 envelopes, each of which held 
a card designating a particular target location. The 10 envelopes were 
randomly selected by “another experimenter" from the target pool which 
"had been compiled by a person who had no other affiliation with the 
experiment and who was the only person familiar with one contents of the 
envelopes." 

The target person drove continuously for 20 minutes, or until 5 
minutes after the subject had completed her response. Then, the target 
person selected “at random" a number from 1 to 10 from an enclosed container 
holding 10 identically folded sheets of paper. While still driving, the 
experimenter counted down to that number in the pile of target envelopes 


and proceeded to the target location on the enclosed card in the designated 
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ecieee: timing her arrival to be 15 minutes later, or 35 minutes after 
the subject began her response. The target person remained at the site 15 
minutes, photographed the location, and made notes as to her impression of 
the site. She then returned to the college. 

Typed, unedited pandora of the subjects' responses were attached 


to any associated drawings made by the subjects. 
‘Pata Analysis. Vhe eight transcripts, labeled only A through H, were 
given to the judges in random order. Judges were also given, in random 


order, the photographs and notes taken by the target person at each site. 


Bach judge was asked to blind rank order the transcripts with each location. 


The judges were also taken to visit the target locations, but were 
asked to rank order only in terms of the photographs. The authors do not 
state whether these target site visits occurred before or after the rank 
order procedure was completed. | 

Morris'. method of analysis was applied to the sum of the ranks for each 
target. 

Results. The sums of the ranks were 12, 12, and 15 for the three judges. 
Two judges each had five direct hits out of eight targets. The third judge 
had fous direct hits. "The highest rank given any SARE CHIDE, Was three." 

The eyes for the two ee having a sum of 12 are significant at 
p< 10": She result for the third judge is significant at p < .0005. 

Coneluston. The authors conclude that the results support the existence 
of "perceptual and communication nanos hich lie beyond the senses as 
they are currently defined." 

Critical Evaluation. This paper is presented as a "research brief" 


and is necessarily limited in detail: nevertheless, several critical items 


Log 
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of tigehbaoleey aie wet items which might cause skepticism on the part 
of nonbelievers. Specifically, these are: 

(1) Characteristics, backgrounds, experience of subjects are not 
given. Why did one subject receive two eedena and the other six? How were 
targets assigned to each supcent 

(2) No information is given regarding the contents of specific 
targets in the target pool, nor of the 10 used on any given trial. We 
do not know how similar or different the pool targets are, nor do we 
know how similar or dereevent are the targets in any trial subset of 10. 

(3) We are not told if targets are sampled with replacement, nor 
if any target is used more than once. 

(4) The observer. remaining with the subject is not described other 
than to say the observer "had no knowledge of the target location." We 
do not ioe if this observer coached the subject, knew anything about the 
experiment, was one of the authors, or merely served as a guard. 

(5) The 10 target envelopes were selected by "another experimenter," 
presumably Bisaha. How were they "randomly" selected? Why by the experimenter? 
If the ee with the subject was also Bisaha, there exist other peaaibie 

~ communication channels, both normal and paranormal. 

(6) Who was the person who eee eis target pool? What were the 
criteria employed? Did he have any communication with subjects and judges? 
All these are unanswered. 

(7). How did the target person select “at random" the target designating 
slip of paper? 

(8) No apparent feedback wag given to either subject. It seems that 


ali trials were completed before transcripts were presented to the judges. 
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No mention is made of subjects visiting targets or being debriefed by the 
target person. Further, no niet is made as to the scheduling of trials: — 
over how many days, how many per day, per week, ete. | 

(9) gdagen were asked to rank order the transcripts on the basis of 
the photographs and target person's notes only, although they did visit the 
targets.. This is totally unclear. If they performed the ranking before 

Giateing the targets, then why should they bother to visit the eight targets? 
Tf ey visited the targets before eveorniny the ranking, how could they 
completely disregard the visual (non-photographic) information obtained at 
the target site? Inadequate detail is presented on both procedure and 
rationale. 

(10) The authors state that "the highest rank given any transcript was 
three." Presumably, they mean the highest rank given any correct transcript, 
not merely any transcript, for the ae procedure requires all eight 
transcripts to be force ranked from 1 to 8. 

While this may be re choice of phrasing by the authors, i is 
disconcerting if it indicates a misapplication of the Morris procedure and 
therefore biased results. That is, if the judees scored each transcript 
from 1 to 8, but did not use all 8 ranks per target (over the 8 transcripts), 
rather scoring each transcript independently on a 1 to 8 scale, then the 
sum of fans could easily be much less than the forced sum of 36 per target 
(1 + 9 +3... + 8). Because no data are presented, and because this one 
results sentence is unclear, the conclusions should be viewed cautiously. 

(11) If the outbound person detveeceandonly for 20 minutes, then 
selects. a target, and times her er at the target for 15 minutes later, 
there are some impossible-to-reach targets unless she deliberately drives : 


toward the (unknown) target. That is, targets are within a 30-minute radius. 
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Assume a target is 30 minutes due east of the campus, but the target person 
drives due west for 20 minutes. She cannot chen: tuck. 60 degrees and arrive 
at the 50-minute distant target:in 15 minutes. In fact, if the target is 

30 minutes from campus, the only way bis aan arrive there in 15 minutes is 
to drive nearly toward the target for the 20 minutes before she learns the 
location of the target. The random likelihood of her being within 15 
minutes of such targets is clearly small. Assuming that no time is required 
for the target person to park her car and walk to the target, then the 
approximate probability of her being within a 15-minute radius of the target 


located anywhere in the 30-minute radius target area is: 


_ Cs)? | 
1 (30)2 


0.25. (3) 
Since parking/walking time is nonzero, it seems improbable that the target 
person kept the assigned schedule for each target. The impact of this 
procedural question on the results is unclear, but quite unsettling. 

Summary. This experiment is described very briefly and incompletely, 
causing one to be skeptical of its having a careful methodological base. 
Nevertheless, the results are impressive, in view of both the statistical 


significance and the precognitive nature of the procedure. 


nD. Dunne, B. J. and Bisaha, J. P. Multiple channels in precognitive 
remote viewing. In W. G. Roll (Ed.), Research in Parapsychology, 1977. 


Metuchen, N.J.: The Scarecrow Press, 1978, 146-151. 
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Purpose. The stated purpose of thig research is to replicate their 
previous experimental procedures with the additional "variable" of testing 
two subjects simultaneously. 

In actuality, this pebee presents the same Chicago-area experiment 
reported at the 1977 IEEE International Conference on Cybernetics and 
Society. [See B above.] In fact, the paper is essentially a verbatim 
version ee tiie earlier paper in spite of the later copyright. 

Conelustons. The conclusions drawn by the authors are the same as in 
the revi ote report of this research. id “additions ney acknowledge that 
"the procedure followed for target selection does not exclude the possibility 
of experimenter clairvoyance in choosing the number which yielded a target 
which best matched the subjects’ descriptions, presenting a difficulty in 
specifically demonstrating the locus of the psi process." (p. 150) 

The authors suggest that "the rankings for each transcript against the 
pool of targets be made by a separate judge to control further for 
independence in the ranking process." (p. 150) 

"The positive results obtained from the various experiments ... 
attempted to date indicate that the overall protocol of this experimental 
design is generally a useful and effective tool for additional research 
into the nature of non-ordinary information transfer in ‘ordinary’ people." 
(p. 151) 

Crttical Evaluation. This experiment is a second reporting of an 
earlier publication; thus, the same criticisms apply. In addition, comments 
appear appropriate on a couple discussion points presented by the authors, 


and described above, 
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First, the problem of target selection is a real problem. Selection 
by the experimenter can be a source of contaminating clairvoyant effects, 
as indicated above. However, selection of a neutral third person, who in 
turn selects the target numbers (or targets), is subject to the same 
criticism, étily ona step removed; i.e., the experimenter clairvoyantly 
seieeesoene neutral individual because this neutral een is more 
likely to (will?) select the right target, etc. At first blush, this 
appears to be an insoluble problem. 

Second, the discussion regarding independent judges rankings is 
another example of careless prose. The authors recommend that a separate 
judge should be used for each transcript against the pool of targets. That 
is, under the recommended procedure, a judge would take oné transcript and 
rank Seiee all targets against it, rather than the present convention of 
ranking all transcripts against a single target. While the statistical 
algorithm will be equally valid, it would appear that memory and order 
effects might serve to reduce the judges' abilities because they would 
necessarily have to visit the targets sequentially, rather than compare 
all transcripts "simultaneously" as in the ies conventional protocol. 

Last, the conclusion vepavdige the effectiveness of the protocol is 
highly suspect because of the previously defined travel time problem. If 
targets are really randomly selected five minutes after the subject ends 
his/her response, and if the target person really drives fananaiy for 20 
minutes to arrive at a point 15 minutes from the target, then the target 
person can reach less than one~fourth of the potential target locations 
in the allotted time. This hardly appears to be an acceptable protocol, 


and it is doubtful that it can be (was) followed for each trial. 


Approved For Release 2000/08/18“ CIA-RDP96-00787R000100260003-2 


oo? 


a 
Approved For Release 2000/08/10 “SERRE °° 8787 ROOD TOO2 C0008 


Summary. This experiment ig suspect for the reasons cited previously 
following its earlier publication. The additional discussion of the results 
presented by the authors in this iteration of the paper does nothing to 


dispel those suspicions. 


E. Hastings, A. C. and Hurt, D. B. A confirmatory remote viewing 
experiment in a group setting. Proceedings of the IEEE, 1976, 


October, 1544-1545, 


Purpose. The purpose of thig experiment was to obtain more experimental 
data on remote viewing performance. The research was stimulated by the 
earlier SRI studies. 

Experimental Design. Thirty-six subjects generated information about 
a single (unknown ) target. They then had the six possible targets described 
to them and "voted" for the target they thought to be the site based. upon 
their individual responses. 

Subjects. Thirty-six persons, male and female, served as subjects. 
They were "mostly professional", and “ine one evening (8:30 PM) with the 
understanding that an experiment in ESP would be conducted. No further 
information about the subjects is given. 

Experimenter. Arthur Hastings. 


Target Persons. David Hurt and one person selected from the group of 


subjects. The selection procedure was not described. 


Judges. The subjects themselves voted as the judging procedure. No 
other judges were involved. 
Equipment. Notes and drawings were made by all subjects. No equipment 


was involved. 
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Targets. Six targets were chosen by the -experimenters prior to conduct 
of the experiment. The subsequently selected target was a playground area 
with a log structure in a nearby park. The other five target locations were 
(1) a children's play tunnel, (2) an seenexacee flowering trees, (3) a bar 
and tee eaueants (4) an ice cream parlor, and (5) a post office building. 


The target locations were chosen to provide wide variation in indoor/outdoor 


~ locations and dominant mood. 


Procedures. The targets' names were written on cards which were sealed 
in envelopes and randomly numbered. No one knew the number of any target 
Veuaeians In the presence of the 36 person group, one envelope was randomly 
selected by throwing a die. Hurt and one person from the group then left 
with the sealed envelope. They opened the envelope in Hurt's car and drove 
to the target site, timing their arrival to be exactly 10 minutes after 
their departure. They "observed and interacted with the location" for 10 
minutes, then returned to the group. 

For the 10 minutes the target persons were at the target, the group 
members “attempted to generate information about the target site, making 
notes and/or drawings of their impressions." Following this 10-minute period, 
but before the return of the target persons, the subjects were allowed to 
compare notes. Then, Hastings named the six locations in the target pool 
and desentbed them briefly. (He knew the targets in the pool, but not which 
one was selected.) The subjects then "voted" on which target was the one 
selected. | 

The target persons returned a short while after the vote was taken, 
handed over their envelope, and reported the target to be the playground 


area. 
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Data ‘Analysts. Analysis was by a t-test, comparing the obtained number 
correct with that expected (6) from the null hypothesis. With 6 targets and 
36 subjects, 6 correct "yotes" would be expected by chance. | 

Regulte. Twenty of the 36 subjects voted for the correct site. The 
authors state that a "t-test (one-tailed) for the 20 votes actually given to 
the correct target gives a Z score of 5.22, with a probability of less than 
oie 3 107." . 

Conetustons. The seoaetmereers report "astonishment" by the success of 
the subjects. The subjects reported correctly stich elements as selnwes trees, 
oak lights, sand, and the log structure. ‘Two subjects correctly reported 
images of ehé target team eutine off their shoes. One subject dean circle 
and wrote "playground" in it;. the nonauthor target person "reported that at 
the location she had drawn a circle in the sand and had written 'playground' 
in it." One subject reported the correct name of the park. Other subjects 
correctly reported objects seen From the target site, but not part of it, 
such as "the. jungle gym, swings, lighted windows of houses surrounding the 
park, a soft drink can or the ground." 

The Scie naee attribute the effectiveness of the experiment to the way it 


was conducted. Three conditions seem to help: "(1) Accepting that remote 


. viewing is possible and agreeing that you can do it; (2) Turning your 


attention away from external perceptions and to inner pictures, experiences, 
aad thoughts; and (3) Receiving feedback as soon as possible." Instructions 
to the subjects and procedures during the experiment emphasized these 
principles. (Descriptions of the pertinent techniques Si given.) 

The authors also recommend the foliswiag improvements on their procedure. 


(1) In addition to having the ‘subjects estimate the correct target from 
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their responses, also have outside judges estimate the target from the 
subjects’ responses. (2) The target pool should be made up by someone not 
at the experiment. (3) Clarify whether the coaches (half of each pair of 
subjects) should vote on the basis of their "viewer's" information or with 
consideration for information they themselves have generated. (Coaches 
voted in this experiment with undefined criteria; coaches' votes were not 
separately noted.) 

Critteal Evaluation. While the results are highly positive, several 
methodological questions arise which indicate uncertainty or poor reporting 
re 

(1) The original subject pool had 36 people, male and female. How 
many of each? When ee person (how chosen?) left with Hurt, presumably 
there were only 35 left. Yet, the remaining subjects worked in pairs and 
36 votes were cast before the target dé¥eons returned. How is this possible? 
Was Hastings also one of the coaches (subjects, voters?) in addition to 
directing the experiment? 

(2) How could the experimenters select the targets, put the target 
cards in envelopes, and randomly number the envelopes without knowing the 
number of each target, assuming one of them really wanted to know a given 
target's number? They should have had a disassociated person do this. 

(3) Who rolled the die to select the target? How? | 

(4) At 8:30 PM in March it was dark outside. Was the playground Lighted? 
If not, how could the target persons sce to move about, write satteyaeadni 
in the sand, etc.? A daytime experiment might appear more logical. 

(5) Statistically, the null hypothesis predicts chance success (assuming 


a 


subject independence!) of 36/6 = 6. The authors state that they used a 
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one-tailed t-test to obtain a Z score. This is inappropriate: a small 


va 
sample ¢ does not yield a normal distribution Z or standard score. The 
= t-test was developed to account for the nonnormal distribution caused by 
small sample sizes, typically less than 30. While similar, ¢ and Z are not 
a equivalent. 
te Heine the binomial distribution, one can calculate the Z score for the 
obtained result: . 
oi 
Fw (o + .5) -— WP _ 13.50 _ 6.037. (4) 
ai VEO 2,236 
- Evaluating this Z-score by the known unit normal distribution, we obtain a 
probability of occurrence under the null hypothesis of P rion 
” However, it should be noted that the large sample 4-score approximation 
to the binomial distribution is valid for ” > 25 and P approximately equal 
= 
to Q@=2+ i-P. As the disparity between P and @ increases, ” must become 
- larger for the approximation to be usefully close. A good rule of thumb 
(Siegel, 1956) for this approximation is that PQ must at least equal 9. 
= In this experiment “PQ = 36(1/6) (5/6) = 5. 
Thus, it is most appropriate to evaluate the results by the binomial 
-_ 
distribution. 
oa If P is the probability of occurrence of an event, and that event occurs 
x times out of m opportunities, then the probability density function is: 
= 
r@) = Gy wa - D iamears Cs) 
- 
The cuniulative probability of the obtained result plus all more extreme 
a) results is the value of interest to us. For this experiment, we have 
- 
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‘n= 36, w = 20, and P= 1/6. We wish to find the probability of obtaining 


20 or more correct responses. That is, we wish to know: 


Prob. (20 < « < 36) = £(k). . (6) 


The probability of obtaining exactly 20 correct is 1.08 x ome while the 
probability of obtaining 20 or more correct is 1.24 x ee 

Thus, the exact binomial probability of 1.24 x 10° is slightly less 
fan the authors' quoted probability of 6 x Ao: While the difference is 
unimportant numerically, the statistical selection and incorrectness of 
definitions lead to concern for the authors' appreciation of experimental 
methodology. 


Summary. The obtained results are fairly impressive, in spite of the 


methodological questions and inappropriate statistical techniques. 


F. Jahn, R. G. Psychic process, energy transfer, and things that go 
bump in the night. Princeton Aluwmi Monthly, December 4, 1978, 


pp. S-1 to S-12. 


Jahn, a noted researcher on advanced space propulsion systems and Dean 
of the Princeton University Engineering School, has had a recent interest 
in psychic phenomena. This publication is essentially the talk delivered 
at Princeton on that subject in April 17, 1978. An edited transcript of 
the tape of that lecture is also available, but not for quotation, 
reproduction, or publication. 

The studies of Jahn, in collaboration with Carol Curtyy a Princeton 


student, consisted of a variety of demonstrations and experiments in remote 
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viewing, psychokinesis, and modeling of psychic phenomena. Most of the 


"controlled" experimentation is in the psychokinesis area; since that is 
beyond the immediate interests of this report, it shall be disregarded. 
The remote viewing demonstrations took place early in their studies. 


Since the reported details are sparse, we shall not present them in the 


experimental format used for other publications, but rather summarize them 


in the narrative style used by the author. 

Stimulated by the Puthoff and Targ (1976) IEEE paper, Jahn and Curry 
alternated as target person and subject in demonstration experiments with 
the target person/subject locations being Brookhaven, Long Island/Princeton; 
Princeton/Pompano Beach, Florida; northern New Jersey/Princeton; Stanford 
University Chapel/SRI; Holiday Inn, Palo Alto/SRI; and perhaps others. 

In ee case, there are significant similarities between ie tdeese 
person's. sketch of the target area and the subject's sketch. Often things 
in the sketches are reversed left-and-right; often there is similarity in 
numerosity of elements, such as time in minutes and number of dismountings 


of a horse; usually there is commonality of commonplace things such as trees, 


sky, arches, horses, etc. 


While the similarities are striking, some of the results suffer from 


‘the "grass is green, sky is blue" criticism. Since no independent, uninformed 


judges were used for comparisons and no @ priori response criteria were 
given, these results can only be considered as demonstrations, not as true 
experiments. 

Further, the paper can be criticized on other grounds. The author 
stated (p. $-3) that: "We have tried this type of experiment many other 


times with many other people. Almost always there is some correlation between 
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laboratory at the University of Genie ras isaacs Barbara." The reference 
given to Schmidt's interaction with Curry is dated 1970, while the Morris 
reference is dated 1978. Clearly, Curry was involved in psi activity well 
before she walked into Jahn's office in the spring of 1977, and her interest 
went beyond her "saturation" with ieee, weed enciaeenie and computer science. 


In summary, the results of these incompletely presented demonstrations 


- are interesting and perhaps provocative, but the lack of details on the 


methodologies, procedures, and results preclude this paper from serious 


discussion in this report. Hence, it will not be discussed further nor 


includéd in subsequent analyses. 
f 
G. Karnes, E. W. and Susman, E. P. Remote viewing: A response bias 
interpretation. Unpublished manuscript, Metropolitan State College, 


Denver, Colorado, 1978. 


Purpose. The authors attempted to extend the SRI protocol by applying 
three, major modifications within the framework of a signal detection 
experiment. These modifications are: 

(1) The subjective nature of the subject's responses (and the 
necessity of using uninformed judges to rate the accuracy of the responses) 
was eliminated. Subjects’ accuracies of perception were measured by their 
ability to visually identify color photographs of target locations. This 
procedure permitted the direct measurement of iecimsites as well as 
accuracies of perception. 

(2) A control group was used to exoundé a baseline measure of chance 
remote viewing. The logic here is that, if the subject knows es Catwee 


person will be at. one of X Locations, the probability of chance selection 
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of the correct target may not be ic, due to response biases. The chance 

level should be determined empirically. 

(3) For efficiency, multiple (unselected volunteer) subjects were used. 

Experimental Design. In the experimental group, the target person was 
randomly selected from the subject pool and sent to one of nine target 
locations. The subjects’in the laboratory had photographic booklets of 18 
sites, including the actual target. | 

In the control group, the target person was also randomly chosen, but 
was sent to a location not contained in the photographic booklet. Both 
the subjects and the target person were unaware of this fact, however, 
believing that the location to bac target person was sent was aevuaiiy 
in the booklet. 

Thus, the control group provided a baseline for chance guessing and 
response bias against which the experimental group's responses could be 
compared, 

Gibicete: The subjects were 115 volunteer college students drawn from 
introductory psychology classes. They were told the experiment dealt with 
ESP, and that the experimenters were particularly interested in subjects 
who possessed ESP capabilities or who were interested in eaetaaehety ESP 
capabilities measured. | 

Experimenters. The authors served as experimenters. 

Target Persone. For each group, one of the volunteer subjects was 
selected to be a target person by his/her blindly drawing a blue poker chip 
from a bag of otherwise red poker chips, with the number of chips equal to 
the number of subjects plus target person. 

Judges. No judges were necessary as responses were objectively 


evaluated. 
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Equipment. Four color prints were made of each site, each from one of 
four distinct vantage points. The four prints of each site were mounted 
on an 8-1/2.x 1l-inch cardboard. The nine target and nine “noise" site 
photograph sets were designated A through R, aia placed in a test booklet. 
They were not identified by name, location, or whether each was "noise" or 
"target." 

igniveliope containing the four photographs of a target site and a map 
showing the route to and location of the target SiGen were prepared for use 
by the senders." No mention is made of how many such targets or "noise" 
sites were prepared in this fashion. 

Subjects used a response sheet that had blank spaces next to the 18 
site letter designations. They were instructed to select one or more sites 
as possible locations for the target person and to rate their confidence of 
each selection according to five categories: 

uy a am very certain that this is the correct location 

2) I have a large amount of confidence that this is the correct 
location 

3) I have a moderate amount of. confidence that this is the correct 
Scaeise 

4) I have a small amount of confidence that this is the correct 
location 

5) A possible site, but I have practically no confidence in its 
being the correct location." 

Targets. Twenty architectural sites in and around downtown Denver 
were selected. The experimenters selected these sites on the basis of 


architectural uniqueness, visual distinctiveness, and being within an 
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easy 20-minute walk from the subjects’ iacatsis 

The nine target sites were: (1) a Catholic church interior, (2) a 
downtown college campus library interior, (3) the interior of a large self- 
service igor store, (4) a low income multiunit federal housing project, 
(5) a street of remodeled historical eee (6) a walkway in a redeveloped 
commercial downtown area (Larimer Square), (7) an outdoor amphitheater 
(Greek theater rotunda), (8) a small outdoor park area containing water 
fountains and waterfalls (Skyline Park), and (9) the front entrance to the 
State Capitol Building. 

The nine "noise" sites included three distinctly different college 
classrooms (a lecture hall, an experimental psychology laboratory, and a 
typing/business machine laboratory), a restaurant interior, a college 
bookstore interior, three ieeinecis different pedestrain malls, and an 
indoor swimming pool. 

The two control condition sites (to which target persons were sent, but 
photographs of which did not appear in the subjects' booklets) were (1) the 
front entrance to a large auditorium (Currigan Hall) and a heliopad at the 
rear of Currigan Hall. 

The baci of assignment of each of these 20 sites to one of the stimulus 
groups is given by the authors as "architecturally different and visually 
distinctive." The targets were chosen on this basis, the "noise" and 
contrel group sites ware-ehe remaining sites after the targets were selected, 

Procedure. The sequence of the 11 target sites (9 experimental group 
targets and 2. control group sites) was determined by a table of random 
numbers. Subjects were assigned to these conditions on the basis of their 


appearance for the various sessions of the experiment. Ninety subjects 
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served in the experimental group (10 subjects per target) and 25 subjects 
served for the two control group targets. 

Subjects, upon reporting for the experiment, were read a typed set of 
inevodunkony explanations and instructions, which were identical for all 
115 subjects. The nonuniqueness of the remote viewing ability ae stressed 
to permit subjects to feel "safe to explore the possibility of paranormal 
perception. 

Subjects were told that the. target SouECn would be sent to a site itente 
a 20-minute walk and remain at the site for 10 minutes. During the time the 


target person was at the site, they "should concentrate on communicating ... 


. by trying to receive impressions of the physical surroundings of the [target 


person]." Subjects were asked to observe confidentiality about the experiment 
and not to discuss it with others. 

The target person was dispatched alone and was instructed to view the 
site from the four camera positions during the 10-minute period, trying "to 
communicate ndethes an eosswons of the site in ESP fashion ...." The target 
person returned the envelope to the author's office upon returning. 

Subjects were "told that ‘remote viewing' skill probably varies among 
individuals as does any other human skill and, if they received no impressions 
of the [target person's] location, they should guess at least one target site 
and rate the confidence of their guess (es)."" 

Subjects were individually isolated in offices, were told to familiarize 
themselves with the 18 target sites, were informed when the 10-minute 
"sending" period began and ended, and were instructed to put all materials 


aside and to concentrate on receiving impressions of the target person's 


-location during the "sending" period. 
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Data Analysts. Analysis of data was based on é-tests of proportions 
of responses falling in various categories. 

Results. Table 15 indicates the responses of the 90 experimental group 
Subjects. Note that these 90 subjects made a total of 409 selection responses, 
of which 24 were "hits" and 385 were "false alarms." The 1211 no selection 
responses are broken down into 66 "misses" (no response to the correct target) 
and 1145 "correct rejections" (no response to a nontarget). The associated 
probabilities are also tabled. 

The proportion of correct selections is 24/409 = .0587. ~enenee is 1/18 = 
0555. -The control group data provide a basis for estimating if this a prtort 
chance value of .0555 is valid. The 25 control group subjects made a total 
of 160 selections, 85 (53%) to the 9 target sites and 75 (47%) to the 9 
Neuse" pitas: The difference was not significant, ¢ = 1.22, p > .10. 

Thus, the a prtort chance probability of .0555 is retained as the null 
liynbenants value. A binomial test comparing the obtained .0587 with .0555 
yields a p-value of .395, as reported by the authors. [We calculate .34 
by the exact binomial, and .43 by the Z approximation for large W; in either 
case, the difference is not significant.] Thus, there is no evidence for 
a group averaged remote viewing capability. 

Using signal detection theory, the authors calculate d' to be 0.033, 
which indicates a very weak remote viewing signal eiroacth: However, to 
attach meaning to this emeites Ee proportions of hits (.2667) and false 
alarms (.2516) should be significantly different, and they were not 
(t = 35, p > 10). 

The mean confidence rating for correct selections was 3.208, while the 


mean confidence rating for incorrect selections (misses) was 3.297. The 
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TABLE 15. KARNES AND SUSMAN (1978) RESULTS FROM EXPERIMENTAL GROUP 


RESPONSE z 


SELECTION NO SELECTION 


TARGET 


' STIMULUS 


CORRECT 
REJECTIONS = 1145 
NOISE : 
1145 


cr = 1530 ~ °7484 


409 ; 1211 3 1620 
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difference, while in the iia: Gahoeion: was not significant (¢ = -0.35, 
p > .30). 

Receivers (24) who obtained hits rated these hits with a mean confidence 
of 3.208. The same receivers rated their false alarms 3.607. The difference, 
while again in the logical direction, was not significant (¢ = -1.38, p > .10). 

Confidence ratings attached to selections (guesses). of the nine target 
sites were compared to confidence ratings for the nine "noise" sites. The 
mean for the target sites was 3.44, and the mean for the "noise" sites was 
3.60. The difference was not significant (¢ = 0.61, p > .10), but the 
direction of the difference suggests greater confidence for target sites. 

Someta oue. While none of the statistical analyses provided clear 
support for the existence of a remote viewing ability, all the differences 
in means were in the direction predicted by the existence of remote viewing. 

Critical Fvaluation. This experiment is of particular interest because 
the authors have attempted to apply rigorous scientific method to the 
problem siscss Controls were attempted for (1) response bias and (2) 
response criterion lack of definition, by use of a forced multiple choice 
procedure. The results clearly do not support a remote viewing hypothesis; 
nontheless, Buyeeal of the statistical measures are in the "right" direction 
for RV support, although not nearly statistically significant. 

This paper has been submitted to at least: one refereed journal for 
publication consideration and was rejected as being inappropriate in content. 
Apparently, it has also been circulated informally among other investigators 
because Puthoff and Targ at SRI received a copy and wrote to Karnes and 
Susman with a critical evaluation of the research. Puthoff was kind enough 


to provide us. with a copy of his letter, some of the elements of which are 
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contained in the following evaluation (and referenced accordingly). 

First, the targets were Snscateie ceecced on the basis of their 
distinctiveness, thus following accepted guidelines of other investigators. 
The sequence of target selection ("random") is not well described, nor is 
the person doing the selection. Since clairvoyance on the part of the 
experimenters must always be admitted as a possibility, the use of a "blind" 
third person for target selection would be desirable. 

Second, 25 subjects served in the two control group sessions. While a 
minor point, why an odd number? How were they split between the two groups? 
Details are lacking here. 

Third, subjects viewed the 18 target photo sets before their efforts at 
remote viewing and selected their responses subsequently to each potential 
target. Puthoff, in his letter to the authors, suggest that this very 
procedure virtually precludes success. He states that the meee fundamental 
finding of the SRI work is that "analytical functioning is inimical to 


paranormal perception; therefore, paranormal perception will tend toward 


null in direct proportion to analytical knowledge about target possibilities." 


That is, knowledge of the target population essentially blocked success 
because analytical functioning was included in the protocol. Puthoff feels 
that the Karnes and Susman protocol "in prinetple could not speak to the 
remote viewing phenomenon as we [Puthoff and Targ] understand it, since it 
did not duplicate the most important requirement: free response to unknown 
targets as opposed to forced-choice response to known targets." 

While Puthoff indicates analytical function to be detrimental to 
paranormal performance, he has also landed subjects who, for example, define 


by name their. targets (e.g., Hoover Tower). This allegation is somewhat 
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iieonsivedtc Clearly, if a subject offers a Bpucitie response (e.8-5 
Hoover Tower) he is either right. or wrong. Inappropriate response 
interpretation by a practiced judge is thus precluded! 

This is an extremely important point. If RV takes place best (only?) 
under free-response conditions, then'a conservative scientific method 
approach with no opportunity for response criterion errors seems incompatible. 
Stated another way, response interpretation and evaluation by some judges 
will likely be necessary and objective evaluation of responses seems 
tmposstble. While Puthoff and Targ have certainly attempted to devise 
methodologies which circumvent this constraint, their methodologies thus 
ronal foreign and unacceptable to a segment of the scientific community 
for this reason. | 

Fourth, Puthofé suggests that a "plind" judge is best, and that the 
subject himself is the worst judge. The experimenter is also considered to 
be a baie judge. Yet, Bisaha and Dunne (1977a) found excellent, long 
distance results using both target person and subject as judges. This 
contention is clearly not supported by other investigators, and may not be 
a valid criticism of the Karnes and Susman paper. 

Fifth, the subjects in the Karnes and Susman experiment received no 
feedback regarding their response accuracy. Puthoff feels feedback is 
critical to paranormal functioning. However, if a subject makes only one 
response (participates in only one experiment) then the feedback appears 
quite irrelevant as it cannot change the already completed response and no 
future responses will be pies In addition, Puthoff and Targ have often 
stated that paranormal ability is likely to be at its greatest strength 


on the first trial with a given subject and decline thereafter. 
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Sixth, Puthoff claims multiple Caan) subject experiments 
do not work well. Yet other experimenters have obtained successful results 
with simultaneous subjects Csdeen Hastings and Hurt, 1976; Vallee, Hastings, 
. Sad caahevelas 1976; Whiteon Bogart, Palmer, and Tart, 1976). In fact, 
taken together, ‘there appear to be more "positive" cases of paranormal 
functioning with multiple subjects than there are "negative" cases. 

Seventh, the control condition for response Biaé consisted of sending 
the ae person to a place not, on the 18-target list. To the extent that 
the target person's.actual location has some elements in common with a real 
target, that real target may be selected by the forced choice procedure. 

As Puthoff very cogently points out, this is not a true control condition 
but "rather a measure of the correlation between the target sites actually 
visited in the control condition and the sites to be visited in the 
experimental condition." Unfortunately, the outbound experimenter cannot 
62 sent "nowhere". 

Summary. This experiment clearly ptudued statistically nonsignificant 
results, although several of the comparisons were in the "right" direction. 
The experiment is the closest (of which wevare aves) to classical behavioral 
science methodology and control. Yet, it has been validly criticized as 
violating some of the currently accepted principles of RV functioning held 
dear by currently successful investigators. It appears to be an interesting 
step in the direction of rigorous scientific methodology. Such approaches 
are warranted and needed; yet they should not be taken as a refutation of 


results obtained by less conventional investigators active in the area. 


Approved For Release 2000/08/10 2@3IA-RDP96-00787R000100260003-2 


SEAR 


Approved For Release 2000/08/10 te 


H. Rauscher, E. A., Weissmann, G., Sarfatti, J., and Sirag, 5.~P. Remote 
perception of natural scenes, aiteiaed against ordinary perception. 
In J. D. Morris, W. G. Roll, re R. L. Morris (Ed.), Research in 
Parapsychology, 1975. Metuchen, N.J.: The Scarecrow Press, 1976, 


pp. 41-45. 


Purpose. The authors’ stated purposes were (1) to confirm the existence 


of paranormal perception in the description of remote natural scenes shielded 


against ordinary perception, and (2) to replicate recent experiments of 
Puthoff ay Targ. a 
| Experimental. Design. One subject viewed eight different targets, one 
per day, over a period of two weeks. | 
Bupieehs The subject was a female music student at the University of 
California, Berkeley, “who had no particular interest in ESP, although she 
was open-minded and curious." She was not paid for her participation. 
Expertmenter. G. Weissman monitored the subject. 
Target Person. J. Sarfatti selected and visited the targets. 
Judges. Five judges were selected by either Rauscher or Sirag. No 
mention is made of characteristics of the hudson: 


Equipment. A tape recorder recorded all the subject's verbal descriptions. 


She also made sketches. 


Targets. Ten natural target locations in the San Francisco Bay area 
were selected by Sarfatti. Each was chosen to be distinct in appearance 
and at least 300 meters from all other targets. Each target was described Sy 
a single phrase, assigned a number between 0 and 9, and this target list 
was kept by Sarfatti. Discussion of the list with anyone was strictly 


forbidden. Neither the subject nor the experimenter had any knowledge of 
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the target pool, or even in which city they were located. 


Procedure, The target person, experimenter, and subject met at a 


"test location" one hour before the experiment. The target person and. 


subject were in eye contact for 10 minutes, to establish a feeling of 


rapport. The experimenter siontbgded ie conversation to be sure that no 
site information was divulged to the subject. 

After 10 minutes, the target person left the test location alone, got 
into his car, and randomly selected a site number by putting a "random" 
ten-digit number in an HP=35 calculator, pressing the square root key | 
twice, and reading the resulting third digit from the left. Targets were 
used without replacement; hence, this procebs was repeated if it resulted 
in a target which had been previously selected, 

The target person then drove to the target location, and spent 40 
minutes within 5 meters of the target vantage point, concentrating on the 
age oundimads: “lis involved seeing and attempting to get a feel for the 
gestalt of the target location." Driving time to the target is not stated, 
nor is the ee for the subject to respond to the target. 

The experimenter gave the subject encouragement by asking questions 


about impressions the subject might be receiving about the location of the 


_target person. After 40 minutes, the viewing session was ended by the 


target person telephoning the experimenter to divulge the target location, 


and to permit feedback to the subject by having the subject go to the site. 


This feedback was delayed for the first two sessions. (Length of delay and 
reason for delay were not stated.) 
Each of the five judges received transcripts of the tapes, the subject's 


drawings, the target persons list of target sites, a map, and a set of 
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Polaroid photographs of the target sites. The photographs were made by 
either Rauscher or Sirag, who were rere of the correct target-session 
maAbentwess 

Judges matched the transcripts with the target locations (presumably 
‘dene the photographs, not by visiting the sites, although neither is 
specifically stated). For each eT en they recorded a first, second, 
and third choice of transcript, and also gave a percentage weenie to. each 
choice to indicate the likelihood of its being a first chotce. Judges were 
instructed "to rate each transcript-site correlation independently of the 
other sites. ‘hus the same transcript selected as first choice for one 
site could also be first choice for any other site." Judges were instructed 
“not to interact with one another, with the subject, with the target. person, 
or with the experimenter. 

Data’ Analysts. Values were assigned to target choices on a Sy. 25 
(first, second, third choice) basis. The five judges' choices were pooled 
for each session. "If the correct target was among the top four targets 
chosen by the pooled judges, this ee counted as a hit with a chance 
probability of one-half." 

Results: There were four hits: sessions 3, 4, 6, and 7. "This was 
clearly not a significant result. We ignored the weightings assigned by 
the judges as they did not seem to change our analysis significantly.” 

In spite of the lack of significance, the authors believed that “only 
a high degree of coincidence could account for some of the eipaion 
between the actual target and the subject's descriptions." Specifically, 
ie ieee target closely resembled the second session response, and the 


second target "secmed to be related to" the third session response. Note 
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that: no. feedback occurred after the first session. Her street address 


-knowledge of the first target was in fact erroneous in nature. She was 


also not taken to the second target site until after the third session. 

Conelustons. Authors were impressed by subjective similarities between 
targets and responses, although results were not statistically significant. 
They believe the design could be improved by the following: 

(1) Immediate feedback, and sessions spaced not more than a day apart, 
to facilitate learning and avoid. target "flashbacks." | 

(2) Selection of targets which are as peculiar and different as possible. 

(3) GaepuLeeine subject to give just "primary impressions" and avoid 
trying to recognize exact target. 

(4) Note "frame of mind or mood" of the subject atid correlate that 
with performance. | 

(5) More elaborate techniques for putting the subject at ease, including 
sensory depeieatdon: 

(6) Variation in the experiment, such as a we dosed iion paradigm ee 
using simple objects or pictures. 

Critteal Evaluatton. This experiment was poorly conducted in many 
respects, and thereby presented several “opportunities” to obtain negative 
results. While this was the first attempt at remote viewing research by 
the authors, it nevertheless exhibits several sources of behavioral science 
naive methodology. 


The use of a single, inexperienced subject was an initial risk. 


~ Although some authors claim that all people have some paranormal ability, 


this particular subject had not previously demonstrated such ability, nor 


did she necessarily believe she had the ability. 
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While eavetut target population sone was observed, the statistical 
techniques could have been better. First, the judges should have vistted 
the targets rather than Sayihe photographs. Polaroid pictures are hardly 
wide-angle photographs, and more information might have led to better 
el seiien: Indeed, the sample iewaanes so suggest. Second, ranking only 
three choices is not consonant with the Morris (1972) procedure used by 
Putho££ and Tare. Forced ranking of all target responses could lead to 
a different conclusion if the results were "close." 

Last, the inconsistent use of feedback, comments on "frame se daa. 
acts to use sensory jerivecin: and the like sound like amateur armchair 
psychology of the "what if?" variety. The authors might benefit substantially 
from the advice of someone more deeply trained in behavioral research 
methodology. 

Summary . This experiment is not of particular importance dis to its 
wayetel mucunwdelioatcal flaws. Its results are neither conclusive nor a 


critical test of the paranormal phenomenon. 


I. Solfvin, G., Roll, W. G., and Krieger, J. Meditation and ESP: 
Remote viewing. In W. G. Roll (Ed.), Research in Parapsychology, 1977. 


Metuchen, N.J.: The Scarecrow Press, 1978, pp. 151-157. 


Purpose. This experiment was done in the context of a series of 
experiments exploring meditation and ESP in group situations. The purposes 
of this particular experiment were to (1) explore the "Liking-disliking" 
aspects of the psi production and (2) make the psi process exciting for 


this secondary school junior-senior age group to maximize the possibility | 
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of positive results. Accordingly, as remote viewing situation was chosen 
in which one of the students woud leave the classroom to visit a randomly 
selected location in Durham, N.C., while his classmates sonaeaueas 

Experimental Design. The class was instructed in Eno meditation by 
W. G. Roll for two class sessions. Then several personality tests were 
administered, among them a scale measuring their like-dislike for other 
students in the class. Then, for six apparently successive class days, one 
student went with G. Solfvin to a randomly selected target. The remaining 
students (subjects) meditated and attempted to select the correct target 
Pon a set of fue: 

Subjects. The subjects were 11 males and 5 females in a junior-senior 
class at Durham Academy , a private school in Durham, N.C. The experimenters 
indicate Mies seadente to be highly interested and motivated throughout the 
experiment. 

Experimenter. Apparently the experimenter remaining with the subjects 
was W. G. Roll. 
| | Target Persons. Each day a student was randomly selected from the class 
to accompany G. Solfvin to the target. The student target person was known 
to the subjects and was instructed what he/she idole do at the target location. 

Judges. ‘No judges were needed as the subjects voted on the target. | 

Equipment. Nothing of note. 

Targets. Twenty-eight targets were selected and photographed prior to 
the beginning of the class. Seven pools were formed, each containing four 
dissimilar ieeatvedes None of the targets is listed, named, or described 
in the paper. 


Procedure. ach experimental session lasted about one hour. The 
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student target. person was randomly (procedure not specified) selected and 
left the room with Solfvin. The subjects "would meditate for about 20 
minutes and then attempt to experience what the target person was experiencing 


for another 5 minutes." 


‘Each subject then completed a questionnaire dealing 
with the quality of his/her meditation and indicated how emotionally close 
or friendly he/she eae (on a # to 9 scale) about that day's target person. 
They were then shown photos and instruction sheets of the four sasinia 
target locations, in random order, and asked to rank them “according to 
their own impressions of where" the target person visited. 

The instruction sheets gave the target person the name and address of 
the target location, directions to drive there from the school, and what to 
do at the target. The instructions and target photos were in identical 
envelopes. The target person selected one of the four randomly after 
arriving at the car. Solévin and the target person did not return to the 
classroom until the subjects haa eennea: So. thedy responses. 

No mention is made of daily or other. feedback to the subjects, alhough 
it is reasonable to assume that daily feedback may have occurred. It would 
be unreasonable to assume that the target person would not tell his class- 
mates of the target location. 

Data Analysts. A majority vote was used to determine the group response. 
The Hode Wes ieee to break target ties based upon the mean vote. 

Subgroups of the subjects were formed based upon how they rated the 
target person (liked, disliked) and how the target person ranked them (liked 
by, moderates disliked by). "For the former we calculated the median rating 
from all the [subjects] for all six days. This was used as a cut-off point 


to assign the [subjects] to the 'liking' or 'disliking' subgroups. We then 
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applied the majority vote seeeedude Bane re target responses of these 
subgroups." 

"From the [target person] ranking of his 15 classmates we categorized 
“ranks 1 to 5 as ‘liked by [target person],' ranks 6 to 10 as 'moderate' 
and ranks 11 to 15 as ‘disliked ....' The majority vote procedure was 
also applied to target responses of each of these subgroups for each day." 

The sum~of-ranks statistic for preferentially ranked data, developed 
by Solfvin and Kelly, was applied to examine for individuals achieving 
significant responses. No reference is given for this test. 

Results. "No significant psi scoring was evident in the group majority 
vote rankings. This was also true. of the majority vote rankings of the 
various subgroupings--liked [target person], disliked [target person], liked 
by [target person], moderate, disliked by [target person]. The target 
rankings of these subgroupings did not differ significantly for one another 
nor from the rankings of the entire group." 

"None of the [subjects] showed significant psi scoring, although several 
of them showed tendencies towards psi-hitting ...." 

Conetustons. The authors plan to use the like-dislike concept in future: 
psi research, feeling that the vesuies are suggestive and warrant future 
evaluation. They recognize no group remote viewing positive results were 
demonstrated in this experiment. ; 

Critieal Evaluation. Clearly, no positive remote viewing was demonstrated. 
Possible reasons are the following. 

(1) Inadequate assurances were given to the subjects to encourage a 
_ remote viewing experience. 


(2) The use of a forced-choice response may block the remote viewing 
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phenomenon. aig the Puthoff criticism of the Karnes and Susman paper; 
the same applies here. 

(3) inadeaante or no feedback may have taken place after each trial, 
thereby permitting trace Pas poneeey taeueeaeus from one target to contaminate 
the next. | 

en The aeenodoleny is oie somewhat different from the Puthoff 
and Targ approach. These differences, should a true remote viewing capability 
exist, may have suppressed it in. this experiment. Clearly, however, no 


strong remote viewing results were obtained in this study. 


J. Tart, C. T.. Pst. New York: E. P. Dutton, 1977, Chapter 8. 


In this book, which deals with the author's twenty years of psi research, 
Chapter 8 is devoted to a discussion of three remote vidwine experiments. 
The first two were previously published and are described below (Whitson, 
et al., 1976). The third, espaneicig unpublished elsewhere, is described 
here. | 

eres The author was impressed by the procedures and results of 
the Hastings and Hurt (1976) experiment, and attempted to replicate the 
experiment during the conduct of his two-day workshop on consciousness and 
extrasensory perception for the professional staff of the Nebraska Psychiatric 
Institute. 

N 

Experimental Design. Workshop participants were formed into 25 teams to 
remote view one randomly selected target site. 

Subjects. The subjects were the staff of the Institute who attended 
the workshop. Originally there were 25 teams, each consisting of a coach 


and a viewer. Some participants had to leave early, however, and 25 viewers, 


2 


Approved For Release ae ae “GIA-RDP96-00787R000100260003-2 


Approved For Release ZO00I0SI1 0 eR RApRean © 0! 8 ROCOTOOLEOON2=2 


21 coaches, and 20 intact teams provided responses. No other details are 
known about the subjects. 

Euperimenter. charles Tart. 

Target Persons. Marjorie Hook-Gegoud (workshop organizer) and her 
husband. | 

Judges. Subjects judged their own responses in a forced-choice fashion.» 

Equipment. “About sixty" slides of possible target sites were provided 
to Tart by Hook-Gegoud prior to his arrival in Omaha. Notes and drawings 
were made by subjects. 

Targets. Tart (alone) sclected six slides from the 60 that he “felt 
were visually quite distinct." He then sealed each slide, "along with a 
set of instructions that I made up then and there on appropriate things that 
could be done to interact with the site, in an opaque envelope." No mention 
is made of where these selected slides were stored or what was done with 
the conabiactae target slides. | 

Procedure, The participants axe instructed on psychological Bieesduves 
for eliciting psi for remote viewing, and then divided into two-person teams 
(assignment procedure is undefined). The coach's main functions were to take 
notes of the viewer's imagery, ask questions to help elaborate imagery, and 
so on. 

[Tart then conducted a general ESP test in the workshop room to get 
their psi tanents to operate. Using color slides of four classical 
paintings, he was quite successful. Hastings (later) served as a blind 
judge of the eeatids and correctly matched 24 of the 28 eugnonnes to the 
correct target slide. The target slide, chosen deliberately by Tart (The 


Sacrament of the Last Supper, by Dali) was used successfully in the 
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Maimonides studies, with which both fart and Ilastings were familiar! This 
experiment is considered too confounded in methodology to be critically 
discussed here; it is mentioned only because it was part of the "warm up" 
procedure. | 

The target persons left with all six envelopes and used an HP-25 calculator 
with a random—number generating program to select a target by a number between 
Ll and 6 as the last digit. (They had "to push the [Generate] button many” 
times before they got a number between 1 and 6." How many times is not 
stated.) They then got into their car and started to drive away, opened 
the target envelope, and were to arrive at the target in 20 minutes, at which 
time the subjects would try to remote view. 

After all drawings and Sitar collected, the envelopes were opened 
and all six target slides were projected for the subjects to see. Each 
team voted separately, as did each viewer and zach coach. Voting instructions 
were not. given, although the word "ranking" is used in the text. The 
"Combined first and second choice responses for each site" are presented. 

After all votes were tabulated, the target persons returned to brief 
the subjects. - 

Data Analysts. No statistical analysis of the data is presented (or 
warranted). 

Results. The. results are given in Table 16. Clearly, the results do 
not confirm the existence of remote vicuines However, the author offers a 
strong explanation for the results, as follows: 

When Hook-Gegoud returned, she immediately apologized for "messing up" 
the experiment. The HP-25 give a room in the art museum as the target. Her 


husband stated the art museum was closed that day, which they verified by 


. . 234 , 
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TABLE 16. TART'S (1977) RESULTS 


TARGET SITES VIEWERS COACHES TEAMS 
MORTUARY 17 “LD . 13 
_ MUSEUM | 11 ll 9 
CHURCH (TARGET) 10 | 7 7 
WOOLWORTH'S 8 9 10 
BOOKSTORE 4 2 1 


PRINTSHOP 0 L 0 
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telephoning the museum. They then selected the next target anvelsies the 
church, which they got to on time. 

Hook-Gegoud, throughout Bk experiment, had hoped the mortuary would be 
selected saree target due to the fact that a close friend had died a few 
days earlier and that his funeral was taking place that afternoon at a | 
different mortuary. She had wanted to attend the funeral but chose to 
participate in the experiment instead. 

Conelustons. The author believes the experiment was a "failure" in 
terms of the subjects’ votes. "Yet, the viewers' choices showed a clear 
preponderance of first and second choices for the mortuary (the target site 
that the principal agent had strongly wanted és go to), a second-place vote 
for the room in the art museum (where the agents had been supposed to go), 
and a third-place vote for the church (the site they had actually visited). 
‘The coaches' separate votes and. the team votes also showed a preference for 
the oecdneys sack the room in the art museum and he church also getting a 
very high number of votes." 

Tart believes the results to demonstrate psi, but points out that we 
do not know the Zimits of psi. That is, "we cannot assume that the 
experimenter is independent of the experiment." In this case, the target 
- person's desires would appear to influence the outcome as much as the target 
sexaonte actions. 

Critical Evaluation. This experiment clearly shows negative statistical 
results. Interpreted objectively and scientifically, it does not support 
the remote viewing hypothesis. 

The author's post hoc explanation, while plausible, is untestable. 


It remains interesting speculation. 
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If one assumes that the target person's desires and knowledge can 
influence the results, and further that the experimenter's desires and 
knowledge can also do so, then this experiment is strong evidence for a 
true double blind protocol, one in which both the target person and the 
experimenter are unaware of: 

(1) ene epcoee pool and any element therein, 

(2) the constraints on the target pool, 

(3) any possible nonselected targets, 

(4) any previous experiments involving the subjects, and 

(5) any hypothesized results expected from the experiment. 

These are difficult criteria - meet. They will be discussed in a 
subsequent section of this report. 

Summary . The negative results, edupled with the post hoe theorizing, 
make this experiment of little value in confirming the existence of remote 
viewing. However, the lessons learned from the methodology and results can 


be important. 


K. Vallee, J., Hastings, A. C., and Askevold, G. Remote viewing 
experiments through computer conferencing. Proceedings of the IEEE, 


October 1976, pp. 1551-1552, 


Purpose. The purpose of this research is to extend the work of Puthoff 
and Targ “'to cases in which the participants were several thousand miles 
from each other, with control of sensory conditions automatically and 

! 


unobtrusively provided by the medium of communication .-.", the computer 


network. 
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Experimental Design. Twelve persons had -individual computer terminals 
and attempted to describe ten mineral samples held in a geologist's hand, 
one per day at a prespecified time. Five of the 10 samples were enclosed 
in larger envelopes and labeled a "double-blind" pool. Because all persons 
were not logged onto the computer each day, a total of 33 descriptions were 
contributed by. six persons for the 10 sere ered Thirteen of the descriptions | 
were "double blind" and the remaining 20 were Nepeuct 

Subjects. .Twelve persons served as subjects. They were in New York, 
Florida, Quebec, and California. Each was supplied a computer terminal for 
his/her home or office. They all volunteered to participate. Nothing is 
en of the subjects; however, the four excerpted transcripts in the paper 
indicate some geological knowledge by at least two subjects. Of the 33 
transcripts, 11 were contributed by "author" A. H. In the published table, 
the word "author" presumably means subject, although it is interesting to 
note the similarity of initials to one of the authors of the paper. 

Expertmenter, Messrs. Hudson and Wilson are thanked for "carrying 
out and analyzing the experiments." They ueoaee otherwise described. The 
_ role of the authors in this research is undefined. 

Target Person. “A geologist" sitting at his home terminal selected 
the Sacite (target) each day. He is not otherwise identified or described. 
Judges. These were five persons who had no prior knowledge of the 

correct pairings; they are identified as a sociologist, an editor, a 
physicist, a secretary, and a librarian. In no particular order, the 
following persons are (later in the paper) thanked for serving as judges: 


Ms. Amara, Ms. Chula, Dr. Johansen, Dr. Lipinski, and Ms. Spangler. 
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Equipment. Each subject had a portable computer terminal in his/her 
home or office, linked to a computer teleconferencing system. Participants 
could type in comments at any time. "All comments are immediately printed 
by. the computer on the terminals of any participants who are currently logged 
in (or are stored for later retrieval)." No mention is made of whether or 
not each subject's response was printed immediately on all other terminals. 
The security of the input information, the nature of the system software 
_logic, and other pertinent details are absent from the paper. 

Targets. Ten mineral samples were selected from "geological collections." 
The samples were "the rare mineral bastnosite, a vein filling of galena and 
quartz, opal, gold ore, halite, cinnabar, magnetite, realgar, barite, and 
cobaltite. Subjects were told only that the targets were mineral samples 
from North America. The manner of. select and the person doing the selection 
are not described at all, nor is the storage place of the samples. 

Proestune: “Each day at 7:30 AM and 7:30 PM Pacific Daylight Time, a 
seeveuie sitting at his ews terminal took one of the envelopes from the 
open pool, extracted the sample, and held it in his hand. Anyone logged 
into the conference at that time could volunteer a remote viewing description. 
Such descriptions were recorded and printed by the computer with a date and 
time stamp. After all descriptions were in, the geologist entered a brief 
description of the specimen to provide feedback for the participants. The 
sample was then removed from the cee pool. 

"Similarly, each morning the euvenese for the day was taken from the 
double blind pool and pidead at a designated office location where it was 
a target for remote viewing for eight hours. Anyone logging into the 


conference during that time could type in a description of the sample 
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dsneainea in that envelope. At the end of eis day, the envelope was taken 
to the geologist, who added the sample to the open pool. No feedback was 
given for the double blind targets." | 

Thirteen sic 33 responses were double blind, and 20 were open. Four 
of the 10 targets were run under both open and double blind conditions. 
(Which targets led to responses under each condition is not indicated in 
the paper.) 

The five judges were given transcripts of the responaes (without time, 
date, or subject identification) and the geological specimens. They were 
instructed to assign one or more specimens to each response. "Each Spee haan 
assigned to.a given [response] was aliettad a percentage score which 
reflected the judge's certainty of the ee The total of 100 percent 
could be divided anong sis or none of the [targets]. We then totaled all | 
five judges' assignments for each [response] to find which [targets] scored 
the hime for each [response]." 

Data Analysis. The data were analyzed two ways. First, the likelihood 
that the correct target received the highest score by chance was calculated, 
Second, the percentage scores were evaluated by a one-tailed T [sic] test 


termine the probability that the assigned percentage scores for correct 


incorrect targets were due to chance." 

sults. The results are shown in Table 17, The correct target was 

led the highest score in 8 out of 33 responses. These were the 

ing responses, with subject's initials and target given in parentheses: 
->F)3 6 (R.B.,D); ll (R.B.,1); 16 (1.S.,H); 18 (1.S.,F)3; 21 (R.B.,J); 
-,D)3; and 27 (A.H.,D). 

T seeedee target was assigned the highest score in 8 of 33 cases. 


Since fhance is 3.3 cases, the outcome is stated by the authors to be 
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TABLE 17. RESULTS OF -VALLEE, et aZ. (1976) 


OPEN (0) SCORES 
RESPONSE BLIND (B) SUBJECT BEST 2ND 3RD «ATH 5TH TARGET 


l 0 I.S. J(134) F(60) C(50) G(44) D(30) c 
2 9 A.H.  A(100) 1(60) F(52) H(50) (45) C 
3 B I.S., . F(212) G(50) Cc(10) D(10) H(10) F 
4 OF I.8.  3(100) (76) F(55) K(30) A(10) G 
5 =&B A.H. K(70) H(62) G(60) D 
6 ibs R.B.  D(284) 5(10) D 
7 B R.T. A(205) 1(90) G(80) D 
8 B Le 1(210) 3(40) D 
“29 0 A.H. (150) F(70) 3(50). €(20) I 
10 0 I.S. D(50) J(50) K(50) E(48) C(30) I 
11 0 R.B. 1(208) D(30) C(20) H(20) x 
12 0 A.H.  F(45)  E(20) D(17) E 
13 0 R.B. — F(188) E 
14 B R.B.  K(110) D(56) 3(30) H 
15 B A.H.  A(180). D(10) . F(10) H 
16 ‘B 1.8. (166) H 
17 O- -R.B. D(100) (90) F 
18 0 I.S. F(246) D120). 1(20) F 
19 0 I.8.  G(104) (100) 3(84) J 
20 0 A.H.  F(30) (20) D(6) J 
21 Oo. R.B.  J(56) -1(50) D(30) A(10) C(10) 5 
22 B R.B. H(62) K 
23 B A.H. D(52) G(10) J(10) K 
24 “ B J.B. C(40) (14) K 
25 0 R.B. D(72) ~—«J (10) D- 
26 0 AW. = -3(80) (25) D 
27 0 Awl. = D(55)sE(S)—ssFGS).—s KQ) D 
28 0 R.B D(126) Il 
29 0 A. D(222) (10) H 
30 0. I.S. J(58) (30) (22) A(LO) 1(10) H 
34 3B A. (32) E(30) G(10) (6) A 
32 B R (130) G(124) A 
33 0 R. I(60) D(16) J(L5) K(6) A 
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significant at p < .01. For verification, one can calculate the level of 


significance, using the binomial: 
33 n 33- .. 
CGAY? way) (2) 


0041 


i] 


Thus p is just slightly better than .01. 

For the analysis of percentage scores, the authors use a one-tailed 7-test 
Ge compare assigned percentage scores for correct vs. incorrect targets. They 
report a p-value of 0.08; the value of Z is not reported. They also state 
that the individual p-values for subjects I.S. and R.B. were equal to 0.04. 
| Cetus ore: The authors conclude that "about two-thirds of the pesapensed] 
contained descriptive elements that corresponded with the correct target 
Speetnen. but often these were mixed with noncorresponding elements ...." 
Authors were encouraged by the "accurate and significant remote perception 
ie to] ... 2500 miles away from the targets, ... [and] that the double 
blind conditions provided equally correct descriptions saan | 
Critical Evaluation. This experiment can be criticized on several 
methodological grounds, including at least the following: 

(1) Selection of the subjects chads backgrounds, their knowledge of 
remote wfewany phenomena, and the like are all unknown. 

(2) Did they have communication with one another or with anyone else 
feeahatae- ie eee, Since the eelecouferencine system was available 


to them at all times, such communication is certainly possible. 


(3) Who selected the targets? Are they a representative "random" 
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sample of North American minerals? Who else knew of the target pool? Where/ 
how were they stored during the experiment? If the observers could remotely 
view the double blind targets in eceiebe over the distances involved, it 
seems ebasonauiactiee they could remotely view both open and double blind 
targets at all ttmes. 

(4) The original five open targets were used once each; the original 
five double blind targets were used twice each, once double blind and once 
open,. with the double blind viewing first. This confounding of frequency 
of usage with the double blind vs. open variable limits the sampling assumptions 
of the data. 

Secondly, the experimental wotivete de the data can be criticized as 
follows: 

(1) Subject 1.S. was correct three times, subject R.B. four times, and 
subject A.H. once, out of 10 subjects. This allocation of the eight best 
match correct responses seems somewhat extreme. For any given subject, the 
Likelihood of being correct can be evaluated. 

For subject R.B., who contributed 11 responses (of the 33), the likelihood 


of being correct, by chance, four or more times is: 


l 

p@>4=1-[ 2 (4) 0.1)" (0.997% | (8) 

; n= 
= .0028. 
For subject 1I.S., the similar probability is: 
> 2 9 n 9-n 
pim>3)=e1-f £ ¢) ©.1)” (0.997 7] (9) 
n= 3 


-0083. 
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Subject A.H. responded 10 uae, and was correct once. With an a prtort 
probability of 1/10, little can be said for his performance, ee an author 
or not! 
Note, however, that these three persons contributed 11 + 9 + 10 = 30 of 
the 33 transcripts. Subject R.T. contributed 1, subject J.B. contributed 
1, and subject A.V. contributed 1, for a total of 33. Clearly, the overall 
positive results are due entirely to subjects Ribs and ‘1.8. 
(2) The authors indicate that 8 correct out of 33 is significant at 
p< .01, yet the binomial calculation yields a value of p = .004. The authors 
iene state the test by which they calculated the p-value; it would have 
been more scientific had they done so. | 
' (3) The selection of the t-test for correct vs. incorrect scores is 
awkward. The authors are not very ea ieie which correct and incorrect scores 
they used, nor what value of t was obtained. One might reasonably assume 
that the 15 correct matches in Table 1/7 were used, and compared with the 
penmining 87 scores. If so, this should be evaluated by a non-correlated 
score t-test, even though the scores are clearly not independent. Nevertheless, 


following this approach: 


t = 3.36, df = 100. . (10) 


The exact p-value for t = 3.36, df = 100 is .0011. The authors report 
ap = .08, but do not indicate their basis of calculation. 


For subject I.S., using the same approach, 
t= 2.98, df = 32. . (41) 


The exact. p-value for subject I.S. is .0055. 
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Similarly, for subject R.B., 


t= 2.83, df= 25, p= .009. 


All of the above p-values are two-tailed, but clearly very significant. 
It is unclear to use what t calculation the authors could have used to 
obtain p = .08 for the entire experiment data set. The only other plausible 
possibility is to obtain a mean Guiederdevrs and a mean incorrect score 
for each gubiect (N = 6), and to analyze the difference between these means 


by a paired-score t statistic. This analysis yields a mean, across subjects, 


(12) 


score of 56.17 for correct responses and 64.17 for incorrect responses. While 


the difference of 8.00 is not statistically significant (¢ = -0.25, df= 5, 
p= lO), it is interesting to note that the scores were generally higher for 
incorrect responses! 

Summary. This experiment is interesting in that it uses a different 
task and difgerent methodology. However, the lack of procedural detail, 
coupled with the imprecise and inexact statistical analyses, cause us to 
have less than complete faith in the results. Like many other experiments, 
it would be quite impressive if the reporting were more detailed and ene 
asunodeieed cleaner. As it is, it can only be considered suggestive of 


the existence of long distance remote viewing. 


L. Whitson, T: W., Bogart, D. N., Palmer, J., and Tart, C. T. Preliminary 
experiments in group "remote viewing". Proceedings of the IEEE, _ 


October 1976, pp. 1550-1551. 


Purpose. The purposes were to check on the validity of remote viewing, 


as reported by Puthoff and Targ, and to test such in a group experiment. 
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Experiment One 

Expertmentat Design. Students in an art class remotely viewed one 
target site and attempted to select it from a set of 10 presented in color 
slide form. 

Subjects. Twenty-seven students in an art class at the University of 
California, Davis. 

Experimenter. T. Whitson. 

Target Person. D. Bogart. 

Judge. An employee of the university art department served as judge. 

No other fitovnavion is given. 

Equtpment. Sketching materials and color slides of the targets were 
used. Slides were made by Whitson and Bogart. 

Targets. "Thirty target locations were selected by the experimenters, 
all seni ven minutes driving time from the Davis campus. Of these thirty, 
ten locations clearly differentiated from each other by visual criteria were 
chosen as the target pool. A few examples of the target pool are: .a palm 
tree, a Hammond organ, a bike cudeeoasseusace, and a gravestone statue of 
an angel. 

Procedure. A color slide of each site was sealed in an envelope together 
with traveling instructions from the university to the site. The experimenter 
randomized the envelopes while the target person was not present. 

| The experimenter introduced the nature of the experiment at the beginning 
of the class period and conducted the experiment after the class had been 
drawing for two hours, reasoning that the subjects’ visual imagery would be 
more activated at this time. 

The experimenters sence the SRI studies and emphasized to the subjects 


‘that remote viewing might be a widely distributed perceptual ability. 
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When the experiment began, the target person selected one of the 
envelopes, did not tell the experimenter what it was, traveled to the 
target, and viewed it for 15 minutes. The subjects simultaneously "viewed" 
the target and attempted to produce a "drawing of the images that corresponded 
to the remote site." The experimenter collected the drawings and told the 
subjects the results would be discussed at a later class meeting. 

The target person returned, removed ee remaining nine slides from the 
envelopes, and rerandomized them with the target slide included. The 
experimenter was not present at this time. 

The judge was asked to match a first and second choice of the 10 possible 
target slides to each drawing, as aii 10 slides were projected simultaneously. 
After the judging was done, the target person "revealed the target site to 
everyone concerned." [It is unclear whether this included the eunjecrand 

Data Analysts. First and second choices were counted as hits, a 
ligeouedine decided upon before the analysis." The data are presented in 
Table 18. 

Results. Authors "were not able to apply a formal statistical test to 
this single session ...."" However, they were impressed that the correct 
target received almost twice as many correct matches (11) as the next most 
selected (6) target. 

A binomial ieee can be applied, if one assumes that the a prtori 
probability of a hit, P, is 1/10. Then, there are 11 hits out of the 53 
matches, and: 


53 


oy Onl) 9) 4 


p (m > 11) 


i 
BK 
1 
hoot 
~~ 
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TABLE 18. EXPERIMENTS ONE AND TWO (IN PARENTHESES) RESULTS 


| TARGET FIRST CHOICE SECOND CHOICE* TOTAL 
ANGEL 1 (0) 3 (0) 4 (0) 
BANJO 1 (3) 4 (3) 5 (6) 
BEAN POLE 3 (1) , 2 (2) 5 (3) 
BIKES (TARGET, 2) 3-03) a4 G1) 6 (4). 
BIKE TUNNEL (TARGET, 1) 5 (1) 6 (0) 11 (1) 
- DIRT MOUNDS 3 (0) 2) 5 (2) 
LOGS a 4 (2) 0 (1) 4 (3) 
ORGAN 3 (4) 2 (4) 5 (8) 
PALM TREE 1 (0) 3 (0) 4 (0) 


TRACTOR 3 (0) 1 (1) 4 (1) 


*One second choice not given in Experiment One.- 
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Thus, assuming no drawing bias on the part of the subjects, these 


results are statistically significant at the p < .01 level of confidence. 


Experiment Two 

Purpose. If, by chance alone, the target selected in the first experiment 
happened to meet a vradamineat drawing bias of the subjects, the results 
would be artifactually inflated. Thus, the second experiment was a replication 
of the first, and was also intended to see if images of tunnels (the first 
experiment target) occurred frequent when the target was not a ee 

Experimental Design. Same Sa first experiment. 

Subjects. Fourteen different students in # diferent art class. 

Expertmenter. Same as Experiment One, 

Lfarget Person. Same as Experiment One. 

Judge. A graduate student in the art department. 

Equipment. Same as Experiment One. 

Targets. Same as in Experiment One, except that the tunnel was precluded 
as the target. | 

Procedure. Same as in Experiment One, but Whitson noted before the 
data were analyzed that "this class seemed less interested and involved in 
the experiment than did the first class." 

Data Analysts. No separate analysis was run on this experiment. However, 
the combined data are analyzed, as follows. 

Results. Table 18 also indicates the results of this experiment, which 
appear to be not as good as in the first experiment. The authors conclude 
_ that “of all possible target pairs in both sessions combined, the total 


number of matches assigned to the actual target pair was the third highest 
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of the 90 possible pairs. This is EERE with a one-tailed probability 


of 0.033." 

Conelustons. The authors conclude that the results offer modest support 
to Puthof£ and Targ's results and that they intend to do further experiments. 

Critical Evaluation. The statistical analysis given by the authors is 
somewhat unusual. RppeeeAes they determined that the total number of 
possible pairings (permutations) of the targets in the two experiments is 90, 
and that the 11 (first experiment) + 4 (second experiment) = 15 correct is 
the third highest total. However, the first highest total would be 11 + 8 = 19, 
while the second highest total vould be 11 + 6 = 17. In each of these cases, 
plus the third (actual) case, the 11 comes from the first experiment dadcthe 
second component from the second experiment. Given that the first experiment 
was already conducted, one can look at the feanirs of the second experiment 
by the binomial theorem as wag done above for the first experiment. Then, 


28-n 


2 28 n 
p(m>4=+l-[ & oe) (0.1) (0.9) ] (14) 


Ut 


14211. 


This result is clearly not significant by any statistical criterion. 
Similarly, were the decision made @ prtort to combine the two experiments, 
then the binomial can be used to evaluate the combined number of hits (15) 


out of the total "matches" (81), to obtain 


8 
pim>isy=a-f =e hy (0.1)” (0.999 15) 


= .006. 
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This calculation, while laborious, would appear valid if the decision were 
in fact made prior to the conduct of the: firet experiment to combine the 
data of both experiments. Clearly, such a decision was not made as the 
authors so indicate in the purpose of conducting the second experiment. 
Thus , any combination of the data from both studies, after noting that the 
first produced positive results, has dubious validity. 

In his book Pst, Tart (1977) describes these experiments in essentially 
the same form as in the previously published (and copyrighted) papers. In 
evaluating the first experiment, Tart states "That [the result] seems 
quite gieaieicdue statistically. I say 'seems' because there are some 
technical problems involved in exactly what assumptions are valid for wlehae 
a statistical ceed: for that reason, we did not make a formal evaluation, 
although it would have been extremely significant" (p. 166). His problem . 
is that of response bias, for example, if the Davis art students drew tunnels 
frequently. Of course, this response bias is inherent in the procedure but 
could be considered eliminated, over many experiments, by eandeil target 
selection. 

Following the second experiment, Tart (1977) concludes "It is statistically 
legitimate to combine es results of the two experiments for an overall 
evaluation, and we did so" (p. 168). If the first experiment suffered from 
response bias, and therefore null hypothesis chance probability estimate 
inaccuracies, combining the data of the second experiment with those of the 
first would not give the first set of experimental data instant respectability! 

It would appear that either the authors (or editors) are statistically 
naive, or pietehe authors have combined the data in a form to result in a 
positive verification of remote wiewiake As such, the results must be taken. 


most cautiously. 
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Summary. This paper is but ancthes example of nonconventional analysis 
of paranormal experimental results. The statistical analysis causes the 
reader to be skeptical of the other parts of the experiment. Otherwise, 
the methodology, tersely presented as it is, seems consonant with that of 


Puthoff£ and Targ. 
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IV. EVALUATION OF POTENTIAL CRITICISMS 


Sections II and III of this report have summarized all pertinent 
known research. The SRI work summarized and critiqued in detail in 
Section II was clearly given more attention than the assorted papers 
in Section Lil. Two reasons exist for this differential attention. 

First, SRI researchers Puthoff and Targ have done more research, 
cee tvadaane Huadiee and attention, published more, and generally 
advanced the research concepts more than have the setae investigators. 
Other experimenters have used their basic protocol, with occasional 
navelens and deletions. In a word, tes saee the reigning experts. 

Secondly, other publications, with the exception of the well 
written manuscript by Karnes and Susman, lack sufficient detail to 
perform a critically detailed evaluation. (The SRI work is not reported 
in sufficient detail either, but the multiple eopdeviie provides more 
information than that provided by other investigators.) 

Because a great amount of attention has been drawn by the SRI work, 
Puthoff and Targ have also received their share of criticism. To 
combat this criticism, Puthoff has published a one page summary entitled 
"Potential Criticisms and Responses." It is well done, although our 
eee wigs eons tend to disagree with some of his "responses." 
Since it serves as a good summary of research philosophy, that paper is 
used in this Section of our report as a "straw man" for overall evaluation 
of the SRI methodology. Each potential criticism (Cl through C9) is 
repeated below, along with Puthoff's responses (R1 through R9) and our 


pertinent comments. 
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The use of this rebuttal method ky parioee however, does tend to 
draw attention away from other areas of potential criticism as it makes 
it appear as if these are the only methodotosteal areas of potential 
criticism. Such is not the case, as has been hopereliy demonstrated in 
Section II. The potential criticisms and responses, on the other hand, 


are sufficiently important to warrant separate discussion here. 


Experiment Seleetton 
Cl: The.experiments discussed could be selected out of a larger 


pool of experiments of which many are of poor quality. 


Rl: Selection of experiments for reporting does not take place; 
every experiment is entered as performed on a master log and 
is included in the statistical evaluations. 

Comment: Reported experiments, sketches, and the like are clearly and 
understandably selected. There is no room in journal or open literature 
reports for the 7000+ experiments run with Swann, nor for all experiments 
conducted with other subjects. Unfortunately, as we have dip ins Hemoue brated 
“in Section II, many of the other experiments are not reported, even in 
summary. form, anywhere. Further, statistical analyses are not given for 
some experiments, and contain overlap for other series of experiments. 


This criticism appears valid to us. 


Data Seleetion 
C2: Data for the reported experiments could be edited to show only 
the matching elements, the nonmatching elements being discarded. 
R2: Data associated with a given experiment remain unedited; all 


experiments are tape recorded and all data (tape transcripts, 
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drawings, clay models) are included unedited in the data 

package to be hiaeed and cvaluated. 
Comment: There is inconsistency, although sometimes minor, in the parallel 
publication of the same quoted transcripts. Presumably, judging cues are 
edited out (see Appendix B). This has not been done consistently. This 
criticism is at least partially valid. It is also unclear as to how many 
viewings are allowed both prior to and Following an experiment. From 
one publication, it wppeats that all transcripts are given to the judge, 
Although all data may be pigsty the judges, other readers and audiences 


are given selected data. 


Cuetng . 
C3: The study could involve naiveté in protocol that permits various 


forms of cueing, intentional or unintentional. 


R3: The use of double-blind protocols ensures that none of the 
persons in contact with the subject is aware of either the 
particular target or target pool; similarly, no one in contact 
with a judge is aware of the target-list/subject-output 
Eonaseoadivest For example, judges are not taken to target 
sites by a knowledgeable persons, but rather proceed to the 
target sites, unaccompanied, on the basis of written instructions 
generated without knowledge of subject output. 

Comment: We have shown above that the questions and comments offered by 
the bee Spinner eould easily serve as perceived or subliminal (shaping) 
cues. Similarly, we have shown that, in ae experiments, the experimenter 


does know something about the target pool or has helped to select it. 
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Other concerns about judging procedures and available information have 
already been raised. 7 

“The authors use the term "double-blind" frequently. Yet, they are 
quite naive as to the behavioral science meaning of this term, a naiveté 
which is apparent throughout their publications. Traditionally, '"double- 
blind" refers to an experimenter who collects the data and who is "blind" 
to the purpose, theory, and potential nature of the results of the 
experiment. Similarly, the investigator is "blind" to the subjects, the 
data per sé, and the data ecpoediae, reduction, and analysis. Thus, the 
experimenter has little influence on the desis because he theoretically 
does not know what should be obtained, while the investigator is suffi- 
ciently blind to the direct subject contact and data so that he cannot - 
influence the results. They are both "blind" in a sense, thus "double- 
blind." The word clearly does not apply in either the traditional, nor 


in a meaningful, sense to the SRI protocol. 


Educated Guess 
C4: A subject may be able to guess as to which sites in a given 
area are likely to be chosen as targets, and may have 


familiarized himself with the locations. 


R4: In the statistical judging procedure used, no advantage could 
be gained even if a subject were to be given a ltst of possible 
target sites beforehand and encouraged to fantliarize himself 
pene pases. Even in such an extreme hypothetical case 
(no such procedure was ever used) where a subject could not 


help but render a set of perfect descriptions of target sites, 
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he still has the basic statistical problem of generating 
blind the correct target/description pair sequence upon which 
the statistical evaluation is based. 
Comment: The response is quite correct for the statistical evaluation 
series. ores demonstration experiments, such as Granite Tomb, 
Superdome, Washington Square, Ohio Caves; West Virginia Site, and all 
foreign sites are not subject to statistical evaluation. Previous 
comments have pointed out problems in the results for these targets, 


Thus, the criticism is at least partially valid. 


Target Limitations 
C5: If a subject is given feedback after an experiment that 
| today's target was a fouavata. he knows that the following 
target is unlikely to be a fountain, since: targets are chosen 


for unique differentiable qualities. 


R5: The target pool in use (> 100 target sites) contains several 
fountains, several buildings, several parks, etc., and cieeefone- 
the content of a given target, determined by random entry into 
the target pool, is essentially independent of the eee s 
other targets. 

Comment: Much has already been said about the local target pool, target 
selection, etc. This criticism is at least partially valid. 

. As has been discussed earlier, the target pool did not seem es be 
‘established prior to the beginning of all the experiments and subjects did 
not have, say, two fountains, with the exception of two targets which 


appeared once for two subjects. A sub~pool of targets was also selected 
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from the larger pool; thus, this selection process may have eliminated 


the possibility of more than one type of target appearing. 


Target Generaltty 


C6: 


R6: 


Comment: 


Transcripts generated by subjects are so general as to match 


anything. ("Sky is blue, grass is green.") 


Judging protocol involves differential matching. Therefore, 
true but general statements do not help a judge to preferen- 


tiatly assign a transcript to one site as opposed to another. 


Again, this is a valid response for statistically judged targets, 


but not for many others (e.g., Washington. Square versus Yankee Stadium). 


It should 
i.e., the 


responses 


"Read-In" 


C?: 


R?7: 


Comment: 


often the 


be clear that many transcripts, in fact, match many targets; 
channel is noisy. Why then (and how) can so many excellent 


occur? 


Matches © 


Given a transcript and a target, a judge can "read in" matches. 


Differenttal matching on a blind basis allows matches to be 
"read in" equally for non-corresponding as well as corresponding 
target/transcript pairs, and therefore provides no differential 
aewansee: 

"Read-in" can occur for targets not judged statistically, as was 


case. Experimenter cues in the transcript can be helpful here. 


Such experimenter cucing, or the possibility thereof, must be eliminated 


by protocol revision. 
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Dnadequiie Handling of Judging Materials 
C8: Preparation of qlapiiee materials (transcript typing). may 
provide opportunity for a "leak," or perhaps degradation of 
typing ribbon may provide artifactual information as to 


‘order of experiments. 


R8: Transcript typing is carried out in a random order by 
individuals kept blind to the key; one-time ribbons are used. 
Comment: Typing cues are not nearly as important as transcript content and 
judge's prior knowledge. How does the tape get from the experimental 
room to the typist? The typed transcript from the typist to the judges? 
How are both stored? Other "security" problems seem more important than 


does the typewriter ribbon. 


Post Hoe Photography 
C9: Photographs used to illustrate remote viewing results are taken 
after completion of the experiments, and therefore suffer from 


the fallacy of post hoc matching. 


R9: All blind judging, matching, and statistical evaluation of the 
‘results (which is where the scientific issues are decided) are 
completed before photographs are taken; judges do not have 
access to photographs during their analysis, and therefore 
judges cannot be cued into correspondences observed Bate hoc. 

Comment: We have pointed out several temporal and content problems with 
photographs. Was the San Andrés airfield photograph taken aes the 
judging? Why do aspect syeiee of photographs always coincide with the 


direction from which the subject "views" the target? 
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The authors have "in Five years of self- and other criticism, 
not found a way to fault either the experimental protocols or the 
conclusions derived therefrom." We do not agree, and we believe Section II 
amply documents numerous such faults. The next section offers guidelines, 
within the general SRI approach, to improve this protocol and eliminate or 


reduce many of the criticisms. 
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V. RECOMMENDED RESEARCH IMPROVEMENTS 


Lengthy, careful study would be required to develop a safe, perhaps 
foolproof protocol. Experience with this general type of research would 
be required to refine the protocol further, to render it acceptable to 
the behavioral science research community. Such is beyond our scope and 
responsibility in this report, and perhaps beyond our capability. 

Rather, we offer the fotientne suggestions for improvement in the 
experimental protocol used generally by Puthoff and Targ (and others). 
We believe that these improvements, when used in the context of a “local 
area" series of experiments, will yield valid results which can be used 
to address questions of channel capacity, phenomenon existence, learning 
rates, and the like. Thus, the suggested improvements are classified 


by experimental operation, much as is the SRI protocol (Appendix B). 


A. Target Pool Selection 

'As suggested in Appendix B, to carry out a series of n experiments, 
the target pool should be > n. The target pool should be selected prior 
to the experiment and should contain distinctive targets. Once distinctive 
targets are chosen, however, there should be other similar targets 
selected, such as several fountains. These should have specific, 
individual details so that a general fountain description will not apply 
very well. Most important, the target pool should be ‘selected by someone 
not involved with the experiment and unknown to the experimenters, 
investigators, subjects, or judges. Further, the experimenters et al. 


should not know the size of the target pool. 


Approved For Release 2000/08/102%CIA-RDP96-00787R000100260003-2 


Approved For Release 2000/08/10 : CIA-RDP96-00787R000100260003-2 


Ideally, the targets and their locations should be totally unfamiliar 
to the experimenters, investigators, subjects, and judges. For example, 


the targets could be selected in and the experiments conducted in a city 


- totally unfamiliar to the above individuals. In this manner, cueing and 


reading-in are less likely. Each target should be listed on a separate 
card and should include what aspects of the target are to be viewed, e.p., 
the fountain in a plaza, and from what viewpoint. The particular 
distinguishing aspects should also be noted as well as unique, meaningful 
behavior of a target person fox that specific target. The description 
should then be enclosed in an opaque envelope and sealed. The envelopes 
should then be thoroughly randomized. - No numbering system is necessary. 
The targets should be stored in a safe or container inaccessible to che 
experimenters, investigators, subjects, and judges. Further, the location 


of the safe or container should be unknown to the experimenters et al. 


B. Investigator 

This rae person or persons who designs the experiments and is 
familiar with the Literature. He ases not collect data, select targets, 
prepare transcripts, analyze data, or in any way interact with senate 
of the experiment in a manner by which he might deliberately or 
unintentionally affect the experiment or its outcome. Ina word, he 


remains "hands off." 


C. Subjects 
Subjects can be experienced or inexperienced, as the purposes of the 
experiment dictate. As long as subjects remain totally uninvolved in 


other aspects of the experiments, their characteristics are less important. 
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They should not serve also as experimenters, judges, coauthors, and 


target persons. 


Further, they should not be close friends of the experimenters, 
epeaes cone. or judges. With such a lack of personal familiarity, 
ieneeedcueee behavior by the aubpcees or investigators is less likely 
to serve as a useful cue to the judge, 

| It is assumed that an intelligence pplication of remote viewing 
would, necessarily and desirably, use the same subject(s) repeacedis: 
Thus, succéssful subjects should logically serve consistently in that 
capacity. However, while in a research mode, when the information channel 
is being quantified, care must be taken to avoid artifactual results die 
to data contamination from subject /experimenter communication. The lack 
of repeated use of Targ as a subject is thus supported, even though he 
provided an excellent response to the San Andrés airport. (One must 


wonder why he wasn't used again in view of this highly accurate response!) 


D, lxpertmenters 

Although we fail to see the need for an experimenter to be present 
during the actual transcription, if one is used, this person must be 
totally unfamiliar with the target pool, selection procedure, target 
person, and as many of the other details of the experiment as possible. 
A defined procedure should be established to sabe the subject feel at 
ease, and assure him/her that remote viewing is acceptable. Although it 
would appear unnecessary to repeat this procedure with experienced 
subjects, in order to keep this portion of the experiment standardized, 


it would be best to repeat these instructions. No prevtous results should 
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be shown. In addition, a subject should AoE Be Yold what kinds of 
elements or aspects are to be used in their description of the target, 
but rather ~ describe the perception of the target as sueurately as 
possible. 

If an experimenter is present during the actual transcription, a 
pre-set list of innocuous questions faighic be used. These should be used 
only. if the subject seems to be totally unable to continue describing 


any aspect of the target. 


fi, Target Persons 

If one or more target persons are used, the number of these should 
be Seecttied in advance and then remain constant. It is understandable 
that they must be known to the subject. However, this does not mean 
that they must be present at the site from which the viewing takes place. 
Since the subject does not "track" the target person prior to the start 
of the experiment, every effort should be made to keep the subject and 
target person at a maximimal physical distance before, during, and after 
an experiment. This is easily accomplished if the targets are located at 
a physical distance, such as in another city. 

The target person should receive the target from a person totally 
unconnected. with the aiventnene and unfamiliar to the SeO6y ineniteie: This 
person would not know the contents of the target pool and would select, 
on a predefined eoudc basis, one envelope from the target pool. This 
person would relay the target envelope to the target person at a predesig- 
sates Tearion distant from the location of the target pool and the target. 

An experiment would begin at a predesignated hour on predesignated 
days, the number of each would also be preset, for both individual subjects 


as well as for the total experiment. 
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Targets should be used ienout replacement, essentially for the 
reasons stated in Appendix B. 

The target person should proceed to the designated target and view 
the preselected elements of that target as specified on the target card. 
The target person should do only these prespecified activities, which 


should be uniquely meaningful interactions with that particular target. 


F. Subject Responses 

The subject should begin his/her description of the target at the 
predesignated viewing time. No prior viewing should be allowed. The 
description should be tape-recorded and should include all experimenter 
questions 42 an experimenter is present, although, again, we see no need 
for such. (An uninterrupted videotape should also be used to verify the 
absence of nonverbal experimenter cueing.) A subject should be allowed 
to sketch or model if he/she so desires, but this should also be 
predetermined by the subject and held constant for each experiment. A 
subject sd encouraged to be as dpeuibete as possible, but not told 


what kinds of elements to include. Only one viewing should be allowed. 


G.. Feedback 

Feedback and no-feedback experiments should be conducted. In a 
feedback: situation, only the subject (not the experimenter) should receive 
the feedback. The contents of the target envelope can be transmitted to 
the sib wen: Neither the target person nor the experimenter with the 
subject Sead have any knowledge of the subjece’s response to the target 


or a description of the target. 
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The tape recordings and sketches or models should be dated, sealed, 
and immediately forwarded to an independent person totally unrelated to 
the experiment and unfamiliar with all persons thus far associated with 
the experiment. This individual should hold all Asean Ane the judging 
procedure is complete. This person will also type and edit the tapes, 
eliminating all references to previous targets, including any experimenter's 
question, should they not conform to the criteria for experimenter's 


questions. A target description should be included with the packet. 


H. Judges and Judging 

Effort should be placed on the development of objective judging 
eriteria, perhaps measured es an item count or content analysis, ahianeie 
oe or other techniques better known to psycholinguists. Type/token 
ratio approaches might be modified to meet these needs. Im any case, 
objective criteria for the judging procedure would greatly euduee the 
subjective element in this phase of the experiment. 

Several judges should be chosen who are unfamiliar with the 
experiment and unknown to those who fave participated thus far. While 
they may be selected on the basis of certain personal areeipaees (e.8., 
artistic ability, intelligence, sponsor representatives), they should 
have no professional interest in the research. That is, they speuid not 
be magicians, consultants to the project, coauthors, fellow researchers, etc. 

Each judge should proceed to each target location, ordered randomly 
with the edited tape, associated drawings or models, and the target 
description card. No judge should be given a list of the padeene: ich 
‘quae’ should proceed to the targets in a different random order. At each 


target, the judge should rank all transcripts against that target, as 
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of response criteria, in that there is always some degree of interpreta- 
tion of what a subject says,. the increased use of judges seems beneficial 


and logical. 


J. Target Coordinates 

Tf scanning by geographical coordinates is to be used, the coordinates 
must be weleeted by an unimpeachable person not otherwise connected with 
the experiment or familiar with other persons related to the experiment. 
The coordinates should describe a variety of targets so that a subject may 


not try to guess a particular type, some of which should describe innocuous 


“sites. Preferably these should also vary in geographical location such 


that a subject could not memorize detatted maps of any given geographical 
area. A possible approach is selection, by random number, of a large 
(> 5000) list of worldwide targets of interest. 

The coordinates should be transmitted “JusE prior to the viewing time. 
No maps ana no feedback during the experiment should be allowed. Again, 
there apneaes to be no need for an experimenter to be present. The | 
popes should complete his viewing in a pre-set time period and only one 
viewing should be allowed. Details of the viewing should be relayed 
immediately via a secure computer network or other similar form of 
communication. Sketches should be dated, notarized by time, and mailed 
immediately... Again, if feedback is used, only the. subject should be 


given feedback. 


Kk. Reporting 


A major problem with research in this field is the incomplete, 


inexact, erroneous, and duplicate reporting. . AZZ experimental details, 
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responses, instructions, transcripts, etc. » must be Heporeed:, however 
lengthy and laborious the task might be,. Only in this manner will the 
"loyal opposition" be able to satisfy their desire for facts and 
reanalysis. Only then will they have left only a malfeasance or 


dishonesty criticism. 


L. Application to Intelligence Systems 


Research conducted and reported to date has a number Se ee 
inconsistencies, and methodological weaknesses sufficient to cause concern 
over its validity. If all Eceures are accepted without question, on 
balanee the Fidelity of the remote viewing channel appears to be of 
pimiced intelligence valuc, TIPMEVET that conclusion may be totally 
premature due to the insufficient methodologies used. To assess validly 
the value of the remote viewing channel for operational use, much more 
careful research is emudeed: perferably by several laboratories following 
the same protocols with detailed documentation. It would be particularly 
desirable to have different researchers (i.e., laboratories) conduct 
experiments with the same experienced subjects (e.g., Swann or Hammid). 

In this manner, the reliability of the remote viewing channel can be 
assessed, with a "known capability" subject, yet satisfy the demands of 
the "loyal opposition" by having replication of the research by an 


independent research team using the same protocol. 
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APPENDIX A. SUMMARY AND EVALUATION OF MORRIS’ (1972) 
FREE-RESPONSE ANALYSIS TECHNIQUE 

Several techniques have been devised to permit evaluation of the 
correspondence between stimuli (i.e., targets) and responses (i.e., 
transcripts) to estimate the extent to which any given ‘transeript is 
descriptive of any given target. Previous researchers have dented 
parametric statistical techniques for such, based upon the likelihood 
that a given number of matches of transcripts to targets would occur by 


chance. Others have developed rating or confidence scales to analyze 


such data. Most of these tests assume independence of rr (i.e. 


Sempe ing with eeplanenene although Stuart (1942) devised a critical ratio 
test to handle those cases in which the judge's ratings or responses were 
not completely independent. 

This independency problem is ee reac Baier example of a 
tendency for a judge to avoid assigning any transcript a ranking of one 
for more than one target. If ere has ranked Transcript A number one 
for Target A’, Transcript B number one for Target B', Transcript C number 
one for Target C', and there are four targets and transcripts, then’ he 
is unlikely -to rank anything other than Transcript D number one for Target 
Be 

While parametric tests have been devised to handle such dependencies, 
they are distribution based and have a small error in them, an error 
which becomes larger as N becomes small. 

Morris (1972) offers a general cova for calculating the exact 
probability of a given sum (or less) of ranks for the preferential matching 


approach. © ic also provides a Lable for representative situation calculations. 
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Assume the procedure whereby there are four targets (A' through D') 

and four transcripts (A through D) which must be blindly matched, and that 

the four transcripts must be ranked one through four for each target. Then 

the correct ranks, summed across all four targets, can vary from 4 to 16. 

The data matrix is show in Table Al. Following the procedural requirements, 

- the sum in each target column is 1+2+3+4 +10. The diagonal (underlined) 

scores are the only ones used an the calculation of the summed ranks; thus, 

the sum of ranks in this example is 6. In general, if there are 1 targets 

(and n transcripts), the sum of ranks can vary from 7 to ae with an expected: 


value under the null hypothesis of (1 + 2 +... $7). 


TABLE Al. EXAMPLE OF PREFERENTIAL RANKS MATRIX 


i 


TRANSCRIPTS AN Bh et bt 
A 2 3 3 2 
B 1 1 1 3 
re 3 4 2 4! 
D 4 2 4 = it 


Sn a en 


In general, let 


iva) 
tt 


the obtained sum of the diagonal ranks, 


the number of transcripts, 


= 
i 


nm = the number of targets, and 


Q = zero and all positive integers not excceding (s - n)/N. 
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i 2 E on t-M2-1 
Pedy eee. 5 ee ae ae 
Wooten 220 4 eat 
ern ; 
a, “os ~-# 7) nt Gy 
sae tt PY Te -P G@a Ine - mw? O? 


For the example in.Table Al, this equation is equal to: 


; 6 . y 
7 ea aps Al (= 49 3 32) 
Bee ae CD” Grew? SES a DP 
4 
= sez (1 + 4 + 10) 
2.02 059.:, (A4) 


- When values of 2 and gs become large, the calculations become laborious, 
although not complex. Morris (1972) has calculated the critical values of 
8 for one-tailed p values ranging from 0.20 to Ome assuming that WV = 1. 

Tf n # N, the above equation (3) must be calculated, as it must for exact 
probability weinee or N > 12. 

For the example given in Table Al, Morris' table gives a value of 
+05 <p « ,10, which agrees with the obtained exact p value. 

The method is statistically sia, fueeueh ene Morris (1972) tabled 
values da not permit exact p-value determination. The diligent researcher 
would undoubtedly choose to perform the precise calculations by using 


equation (A3). 
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It must be noted chat this aa iatines test is valid only if the rankings 
are assigned independently for each target. As Morris points out (p. 406), 
the obtained p-values should be used only - a rough approximation in the 
case of one judge ranking a constant response transcript set to a constant 
target pool. This caution is emphasized especially in the case that (1) WV 
is six or less, or (2) the judge has previously not assigned any transcript 
a rank of one or more than one occasion. 

The first .caution (VW < 6) does not violate the sampling eevee of 
the statistic; rather, it suggests that a judge is more likely to be 
influenced by his memory of rank of transcripts applied to previous targets 
when the number of transcripts is small. When the number of iconacninee is 
larger than 6, presumably the uncertainty increases to the extent that the 


judge's rankings approximate independent responses. No data are offered to 


support this notion. 


The second caution is simply another means to assess the independence 
of the judge's rankings. If he has not redundantly ranked the same 
bpananiipe one. before, there is eyidente he is not behaving independently, 
i.e., ranking with replacement. The caution seems reasonable. 

Morris further indicates that either (1) or (2) is particularly pertinent 
if more than one-third of the number be anes are correct and therefore 
contributing substantially to the small value of s. When a single judge 
and neal pawendances pool are used, other statistical procedures should be 


devised and used, contrary to current practice among researchers. 


Improvements on the Method 
Two general techniques are validly offered by Morris (1972) to solve 


the nonindependence problem. In the first method, separate judges might 
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SEGRE 


be used. for each "ranking of the targets." This wording would suggest 

that a siugis judge rank all targets against a given response transcript. 

Such a procedure would involve sequential visits to all targets and 

necessarily rely upon the judge's memory for at least some target details. 

A better method would be to have a single judge rank ait transcripts for 

a given target, thereby having no knowledge of the other targets in the 

pool or how the same set of transcripts might be ranked for any other target, 
| ‘The second methodological improvement requires that a judge be given 

one response transcript and its target (unknown) plus “other similar non- 

target materials which are changed from one ranking to the next. That is, 


the judge might receive Transcript A along with materials describing 


Target A‘ and nontargets E', F', G', etc. (Table Al). J£ the number of 


‘targets (plus nontargets) is large,-then.1 > WV, but equation (3) can still 


be applied. 
As WV becomes large (that is, the number of targets in an WV = 7 estiuent 
becomes large), the judge's task becomes more difficult in the "standard" 
protocol: therefore, it may be more practical to increase m than M, and 
let each judge rank on only one target. A good rule of thumb, suggested. 


by Morris (1972), might be to not use this exact test when mW < 35. 


Coneluston 
While Morris (1972) is an important paper, and his analysis technique 
is followed by many researchers, there remains cause for concern. Certainly, 
it is more desirable to calculate the exact probability of a given ¢ than to 
use the tabled value, and the calculation is not very complex or demanding. 
Of greater importance is the problem of nonindependence of rankings by 


the same judge. Most researchers disregard this problem, others argue it 
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away By indicating that some judges do in fact rank the same transcript 
"one" on two or more targets. ‘Neitnes is an acceptable approach; the 
second aeaunene merely points out that independence existed (or a 'mistake™ 
was realized by the judge) on one specific set of responses. What is. 
needed is a more thorough measure of exact probability which ieee anes 
account the degree of nonindependence, much as a covariant might be used 

in parametric analyers to remove confounded sources of variation. 

Perhaps of the greatest heuristic concern in this method is its partial 
use of ae data. For the case enige 1 = N, ‘only n of the n® data points 
(ranks) are used. The Gn ~ 7) unused data becomes large as » increases. 
For example, in the » = 4 case, only 254 of the rankings enter into eee 
analysis. In the » = 9 case, only 11% of rankings are used! An exact | 
probability method based on the correlational relationship in the total 
data matrix should be developed. It would potentially provide greater 


sensitivity and more confidence among readers unfamiliar with this particular 


area of research, 
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APPENDIX B. REMOTE VIEWING PROTOCOL 


The following is a verbatim copy of the remote viewing prongeess: 
as described in. a written communication from H. Puthoff to a sponsor 


in late 1977. 
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| REMOTE VIEWING PROTOCOL 


With regard to replication of our standard remote viewing protocols, 
‘the basic outline is as given in our tutorial paper, "A Perceptual 
Channel for Information Transfer over Kilometer Distances: Historical 
Perspective and Recent Research, "H, Puthof£ and R. Targ, Proc. IEEE, 
pp. 329-354, March 1976 (4 copies enclosed). The elements of the 
protocol, each of which I address below consist of (a) target pool 
gelection; (b) subject orientation; (c) outbound experimenter behavior; 
(d) inbound experimenter behavior; (e) post-experiment feedback; 

(f£) judging procedure. 


(a) Target Pool Selection: To carry out an experimental series of, 
say, n experiments with a subject, a list of outdoor targets >> n 

should be prepared in advance by an experimenter who will not interact 
with the subject or experiment after that. The targets should be 
chosen to be distinctive, but not necessarily distinct from each other; 
that is, rather than a collection of nondescript street corners one 
should select bridges, towers, fountains, gardens, plazas, etc., so 

that a judge could in principle recognize targets on the basis of 
correct, but sketchy descriptions. On the other hand, once having 
chosen a fountain-type target, there should be several fountain targets; 
for a bridge target, several bridge targets, etc., so that you avoid 
the subject strategy of "T had a tower yesterday, so it can't be a 

tower today.” In fact, the subject should be told explicitly that the 
targets are not chosen to be orthogonal to each other. 


When the target list is made, each target location should be written 
on a card and placed in an envelope, the envelopes randomized and then 
numbered:so as to lose all track of a key. These should then be stored 
in a secure safe or similar container. 


With regard to whether a target is replaced in the pool after use, 
there are two ways to go. The preferable one is to not replace it, 

but keep near-replacement statistics by simply having a very large pool 
with several similar targets, or else replacing a used fountain target 
with another fountain target. The problem with straight replacement 

is that the subject would, upon becoming aware of a mental image of a 
previous target, be biased to reject it as memory. Therefore, even 
though straight replacement makes some psychologists happy, it is 
actually an artifact-producing procedure. 


(b) Subject Orientation: Before the experiment, the subject should be 


shown some previous remote viewing results with one goal in mind--to 


paper are good examples. In Figure 4 the subject had absolutely no 
concept of a pedestrian overpass, but simply saw a pattern of receding 
squares; the target in Figure 6 with passable drawings was interpreted 
as a restaurant; even the correctly dimensioned pools of water in- 
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Figure 3 were misinterpreted as purification plant pools rather than 


recreational swimming pools. Reading of our book Mind Reach (Targ and 
Puthoff, Delacorte Press, 1977) provides a good background, as we go 
into this aspect in much more detail than we could afford in our 
technical papers. They need to "get tt" that a rounded piece of blue 
metal is just that, and they shouldn't try to figure out whether it is 
a car fender before they say anything. Remind the subject that imagina- 
tion constitutes noise in the channel, and therefore the closer he can 
get to raw uninterpreted tmagery, the better. To have success in the 
above, the best guideline we have found is to choose as subjects 
individuals who are self-confident, not afraid to be wrong, uninhibited, 
etc. No psychological test we have tried (and we have tried them all) 
is as successful as the above subjective assessment when it comes to 
choosing subjects. Artist types used to unevaluated observation are 
among the most successful. 


“(c) Outbound Experimenter Behavior: At the start of an experimental 


session, the inbound and outbound experimenters and subject should 
rendezvous for a relaxed informal chat in the laboratory setting. (The 
outbound experimenter or experimenters must not know the target at 

this time.) Together they agree on a time for the subject description 
to start. (E.g., 30 minutes hence--the length of time required for 
getting to the furthest target in the pool. This time is then an 
invariant for all experiments.) The outbound experimenter then leaves 
the lab, uses a random number generating procedure to obtain a number 
from 1 - ...(number of targets in pool), obtains the so-numbered 
envelope from the target pool (preferably kept by another person) and 
leaves the premises, (We use a Texas Instruments SR-51 hand calculator 
which has a random number function.) . After driving away from the 
laboratory, he opens the envelope to determine the target, .and proceeds 
to that location. TI. suggest he arrange to park and then come upon the 
target location at exactly the starting time so his view of it is 

fresh at experiment beginning. He then simply pays attention to the 
environment and does not let his mind wander (especially to another 
target). It appears not to matter how many people comprise the 
outbound team, provided they don't (1) just pay attention to each 

other or (2) scatter about. At the end of the agreed-upon target 
viewing time they return to the lab (usually 15 minutes). 


(d) Inbound Experimenter Behavior: During the period that the outbound 
experimenters are enroute to the target, the inbound experimenter and 
subject have a period to relax and discuss the protocols. (Inbound 

it is best not to have additional observers.) The goal of the inbound 
experimenter during this period is to make it "safe" for the subject 

to expertence remote viewing. This typically includes a low-key pep 
talk as to how remote viewing appears to be a natural, not abnormal, 
functLon, that many people appear to have done it successfully, even 
their first time, and always the reminder to eschew analysis and 


simply render raw impressions. 
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Since we think that remote viewing is a difficult task, like perceiving 
a subliminal stimulus, we think it takes the full attentive powers of 
the subject. Therefore, the environment, procedures, etc., should be as 
natural and comfortable as possible so that as little attention as 
possible is on anything other than the job at hand. No mumbo-jumbo, 
hypnosis, strobe lights, or sensory-deprivation procedures, since all 
these (novel) environmental factors take away some of the subject's 
much-needed attention. We are in this sense proponents of a "naturalist 
school." If the subject feels more comfortable smoking or drinking a 
cup of coffee, why not? These should be arranged ahead of time, however, 
so that neither subject nor experimenter leave the experimental room 
while waiting for the outbound experimenter to reach his target. 


The experimenter should have arranged ahead of time to have pen and 
paper available for drawing, and a tape recorder. When the agreed- 
upon experimental time arrives; the inbound experimenter simply asks 
the subject to "describe what impressions come to mind with regard to 
where the outbound experimenter is." Most subjects prefer to close 
their eyes, but they should simply do what comes naturally. The room 
lighting is preferably subdued to prevent after-image highlights, 
shadows on eyelids, etc. It is best that the inbound experimenter not - 
push. the subject to say a lot, but act as if they have all the time in 
the world; otherwise, a subject may tend to embroider descriptions 

just to be saying something to please the experimenter. If the subject 
tends towards being analytical ("I see Macy's on El. Camino Real"), 

the experimenter must gently lead the subject into description, not 
analysis. ("You don't have to tell me where it is, just describe 


what you see.") This is the most important and difficult task of 


the inbound experimenter. 


It is also useful for the inbound experimenter to “surprise” the subject 
with new viewpoints. ("Go above the scene and look down--what do you 
see? If you look to the left, what do you see?) For some reason, the 
subject's viewpoint appears to.shift rapidly with a question like this, 
“and the data sneaks through before the subject's defenses activate to 
block it out. The shifting of viewpoint also obviates the problem of 
the subject spending the entire time giving meticulous detail on a 
single blade of grass or piece of concrete, which, even if true, will 
be of no help to a judge. Once a subject feels he sees something, he 
tends. to hand on to this perception rather than commit himself to a 
new viewpoint. 


The subject must be encouraged to sketch what he sees, even over his 
objections that he is not an artist, can’t sketch, etc. He may do so 
throughout, or wait until the last five minutes if intermittent drawing 
would distract this concentration. Since drawings tend to be more 
‘accurate than verbalization, this is an extremely important factor 

for good results. 


(e) Post-Experiment Feedback: When the outbound experimenter returns, 


the inbound and outbound experimenters and subject should proceed 
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directly to the target for feedback. This helps to develop the subject's 
subjective sense of what in his mental imaging is correct versus 
incorrect, and completes that experiment for him so that when he does 

a following experiment, his mind is not still on wondering how he did 

on the previous one. Only a very expetienced subject can function 

well time after time without feedback, so this must be done to insure 
success. 


(f) Judging Procedure: In a sense, all the action in the remote 
viewing procedure is in the judging. -Any single experiment in remote 
viewing, even if perfect, can in principle be dismissed as possibly 
coincidence. Further, any result less than perfect can be dismissed 
as a generalized "grass is green, sky is blue" transcript which fits 
every target. Only blind differential discrimination across a series 
of targets can put both of these alternatives to rest. 


The judging procedures are as follows. First, an experimenter not 
involved in judging must read the transcripts and delete from them 
any reference to dates or previous targets, so that a judge could not 
order the ranscripts chronologically, or determine that a given 
transcript can't be the boathouse because the subject mentions in the 
transcript that what he is looking at reminds him of the boathouse 
which was the previous day's target. With these deletions, the 
transcripts with their associated drawings are labeled in random order 
and given to the judge in one hand, so to speak, while a list of the 
target cards, also in a (different) numbered random order is given to 
the judge in the other hand. His job, then, is to go to a target 
location (physically), read through all the transcripts, and order 
them best to worst match (1 through 6, say, if there are six targets 
and six transcripts). He then proceeds to a second target site and 
reorders the same set of transcripts again, best through worst match, 
and so forth. The jduge is to do this exercise ina replacement 
sense; that is, even though he may have assigned a given transcript 
as best match to a given target, he may find at another target that it 
is the best match to that one also. Even though he knows logically 
that it couldn't go to both, we find that judges in fact have no 
hesitation in using a transcript twice in first place, simply because 
they aren't sure as to which one it does in fact belong, and they 
want to insure the best possibility of not missing a potential match. 
Based on this we feel it is more appropriate to use statistics based 
on replacement. Some argue with this, and if one thinks it is more 
correct then one can use statistics or matching without replacement. 
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